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MODEL-THEORETIC APPLICATIONS OF COFINALITY 
SPECTRUM PROBLEMS 

M. MALLIARIS AND S. SHELAH 


Abstract. We apply the recently developed technology of cofinality spectrum 
problems to prove a range of theorems in model theory. First, we prove that 
any model of Peano arithmetic is A-saturated iff it has cofinality > A and 
the underlying order has no («;, «;)-gaps for regular k < X. Second, assuming 
instances of GCH, we prove that SOP 2 characterizes maximality in the in- 
terpretability order <*, settling a prior conjecture and proving that SOP 2 is 
a real dividing line. Third, we establish the beginnings of a structure theory 
for NSOP 2 i proving for instance that NSOP 2 can be characterized in terms 
of few inconsistent higher formulas. In the course of the paper, we show that 
pg = tg in any weak cofinality spectrum problem closed under exponentiation 
(naturally defined). We also prove that the local versions of these cardinals 
need not coincide, even in cofinality spectrum problems arising from Peano 
arithmetic. 


In a recent paper [5] we connected and solved two a priori unrelated open ques¬ 
tions: the question from model theory of whether SOP2 is maximal in Keisler’s 
order, and the question from set theory/general topology of whether p = i. This 
work was described in the research announcement [9] and the commentary m- In 
order to prove these theorems, we introduced a general framework called cofinality 
spectrum problems, reviewed in below. 

In the present paper, we develop and apply cofinality spectrum problems to a 
range of problems in model theory, primarily on Peano arithmetic and around the 
strong tree property SOP2, also called the 2-strong order property. We prove the 
following theorems: 


Theorem (Theorem |4.7[ ). Let N be a model of Peano arithmetie, or just bounded 
PA, and X an uncountable cardinal. If the reduct of N to the language of order has 
cofinality > k and no (k, K)-cuts for all k < X, then N is X-saturated. 


On the earlier history, which involves m and [TB] VI.2-3, see ijd] We also address 
a question about balanced pairs of models of PA. The proof of Theorem 4.7 relies 
on the answer to a question arising from [8], of intrinsic interest: 
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Theorem (Theorem | 2 . 10 |. Let s be a cofinality spectrum problem which is closed 
under exponentiation. Then pg = tg. 


As explained in (Q Theorem 2.10 complements a main theorem of [5], which 
showed that tg < ps for any cofinality spectrum problem s. As a consequence, we 
are able to characterize tg in terms of the first symmetric cut. However, as we show 
in the local versions of these cardinals, pg^ai ts,a need not coincide unless the 
underlying model is saturated. 

We then turn to the strong tree property SOP 2 . A major result of [5] was that 
SOP 2 suffices for being maximal in Keisler’s order < 1 . It was not proved to be a 
necessary condition, but we conjectured there that SOP2 characterizes maximality 
in Keisler’s order. The difficulty in addressing this question may be in building 
ultrafilters. However, in the present paper, for a related open problem, we give a 
complete answer: 


Theorem (Theorem 6.14 under relevant instances of GCH). T is <f -maximal if 
and only if it has SOP2. 


The ordering <* refines Keisler’s order, but is defined not in terms of ultrapowers 
but rather in terms of interpretability. Theorem |6.14| answers a very interesting 
question going back to Dzamonja and Shelah [T] and Shelah and Usvyatsov 
We inherit the assumption of a case of GCH from [24], where one direction of the 
theorem was proved, building on work of [T|. The direction proved here is in ZFC. 

Theorem |6.14| gives decisive evidence for SOP 2 being a dividing line, by giving 
the equivalence of a natural inside/syntactic property and an outside property. 
However, this was done without developing a structure theory. So in we develop 
the beginnings of a structure theory for NSOP 2 . We define a notion of ‘higher 
formulas’ using ultrafilters and prove, for example, that: 


Theorem (Theorem 8 . 21 ). T is NSOP2 iff for all infinite A, the number of pair¬ 
wise 1-contradictory higher Lp-formulas over A is < |A|. 


Section contains several other results, notably the “symmetry lemma” states 
that NSOP3 can be characterized in terms of symmetry of inconsistency for these 
higher formulas. We also prove that SOP 2 is sufficient for a certain exact-saturation 
spectrum to be empty, connecting to work of Shelah |22j and Kaplan and Shelah 
[7|. The results seem persuasive and we believe they begin a structure theory for 
NSOP2 theories. The introductions to each section contain further motivation for 
these results and discussions of prior work. 

Sections 5 and 8 may be read essentially independently of prior sections. Section 
7 uses one earlier theorem; the reader interested in the < 1 * result may wish to begin 
there and refer back as needed. 
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1. Background on cofinality spectrum problems 

Roughly speaking, a cofinality spectrum problem s = {M, Mi, M~^, , A) is 

given by: 

• an elementary pair of models (M, Mi) which can be expanded to the ele¬ 
mentary pair (M+jM)*"), and 

• a set A of formulas in r(M) defining discrete linear orders, closed under 
finite Cartesian products, 

such that in the expanded model , 

• each instance of a formula in A defines a “pseudofinite” linear order, mean¬ 
ing that each of its Mj^-definable subsets has a first and last element, 

• on at least one of the Cartesian products, the ordering is well behaved, e.g. 
like the Godel pairing functionj^ 

and 

• (M+,Mj^, A) has “enough set theory for trees,” meaning essentially that 
for each ip £ A there is ip G t{M^) so that for each linear order defined by 
an instance of ip, there is a tree defined by an instance of tp: 

— whose nodes are functions from that order to itself, of length bounded 
by a distinguished element d of the order, and 

— the basic operations on this tree (the partial order on nodes given by 
initial segment, the length of a node i.e. size of its domain, the value of 
a node at an element of its domain, and concatenation of an additional 
value) are likewise uniformly definable. 

Natural and motivating examples of cofinality spectrum problems may be con¬ 
structed beginning with pairs of models of Peano arithmetic or pairs of models of 
set theory for (M+, ) with M being a reduct to a language containing linear 

order; or beginning with a pair (M, Mi) where Mi is an ultrapower of M, using the 
theorem that ultrapowers commute with reducts. See |5] §2.3 for more details on 
these examples. The fruitful idea was simply that, in some sufficiently rich model, 

^Godel’s pairing function orders pairs of ordinals first by maximum, then by first coordinate, 
then by second coordinate. If e.g. there is a total linear order on the model, it makes sense to 
compare (“maximum”) elements in any two such ordered sets; if not, this requirement may be 
satisfied by some a X a, that is the Cartesian product of a given ordered set with itself. 
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one may study the amount of saturation in an underlying linear order in relation 
to the fullness of the derived trees. 

Here are the formal definitions, originally given in [S]. 

Definition 1.1 (Enough set theory for trees, [5] Definition 2.3). Let Mi be a model 
and A a nonempty set of formulas in the language of Mi. We say that {Mi, A) 
has enough set theory for trees when the following conditions are true. 

(1) A consists of first-order formulas (p{x,y;z), with £{x) =£{y). 

(2) For each ip G A and each parameter c G Mi, p{x, y, c) defines a discrete 
linear order on {d : Mi \= (p{d, d, c)} with a first and last element. 

(3) The family of all linear orders defined in this way will be denoted Or(A, Mi). 
Specifically, each a G Or(A,Mi) is a tuple (Ala, <a) Cai where: 

(a) Aa denotes the underlying set {d : Mi ^ (pa(d, d, Ca)} 

(b) X <B,y abbreviates the formula (pg,{x, y, Ca) 

(c) da G Xa is a bound for the length of elements in the associated tree; it 
is often, but not always, maxAa. If da is finite, we call a trivial. 

(4) For each a G Or(a), (Aa,<a) is pseudofinite, meaning that any bounded, 
nonempty, Mi-definable subset has a <a-greatest and <a-least element. 

(5) For each pair a and b in Or(A, Mf), there is c G Or(A, Mi) such that: 

(a) there exists an Mi-definable bijection Pr : Xa x Ab -G Ac such that 
the coordinate projections are Mi-definable. 

(b) if da is not finite in Xa and db is not finite in Ab, then also d^ is not 
finite in Ac. 

(6) For some nontrivial a G Or(A,Mi), there is c G Or(A, Mi) such that 
Ac = Pr(Aa X Aa) and the ordering <c satisfies: 

Ml ^ (Vx e Aa)(3y e Ac)(Va;i,X 2 G Aa)(max{xi, 0 : 2 } <a x Pr(a;i,a; 2 ) <c y) 

(7) To the family of distinguished orders, we associate a family of trees, as 
follows. For each formula (p{x,y;z) in A there are formulas 'f’ei,ipi,ip 2 of 
the language of Mi such that for any a G Or(s) with tpa = f- 

(a) ipQ{x,Ca) defines a set, denoted Ta, of functions from Xa to Aa. 

(b) ipi{x,y,c) defines a function Iga : Ta Aa satisfying: 

(i) for all bGTa, Iga(^) <a da. 

(a) for all b G Ta, Iga(^) = max(dom( 6 )). 

(c) '>p 2 {x,y,c) defines a function from {{b, a) : b G Ta, a G Aa, a <a lga(^)} 
into Aa whose value is called vala{b,c), and abbreviated b{a). 

(i) if c G Ta and Iga(c) < da and a G Xa, then c^{a) exists, i.e. 
there is c' GTa such that lga(cO = lga(c) + l) c'(lga(c)) = a, and 

(Va <a lga(c))(c(a) = c'{a)) 

(a) 'ipo{x,c) implies that if bi 62 G Ta, Iga(^i) = lga(^ 2 ) then for 
some n <a Iga(^i), bi{n) T b 2 {n). 

(d) ip^{x,y,c) defines the partial order <ia on Ta given by initial segment, 
that is, such that that bi Oa ^2 implies: 

(i) for all b,cG Ta, b<ic implies lga(&) <a Iga(c)- 
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(li) Iga(fel) <a lga(^2) 

(in) (ya <a Iga(^i)) ihia) = 61 (a)) 

The family of all Tg^ defined this way will be denoted Tr(A,Mi). We refer to ele¬ 
ments of this family as trees. 

Notice the pairing requirement in condition (6). While we need Cartesian prod¬ 
ucts to exist, it is largely unimportant what exactly the order on these products 
is (as long as it satishes the other requirements). It’s sufficient for the results of 
[8] that one such order behave well, like the usual Godel pairing function. In the 
course of the present paper, we will consider weakenings of this requirement. 

Definition 1.2 (Cofinality spectrum problems, [5] Dehnition 2.4). We call the 
six-tuple 

s = (M, Ml, M+, M+, T, A) 
a cofinality spectrum problem when: 

(1) M < Ml. 

(2) T D Th{M) is a theory in a possibly larger vocabulary. 

(3) A is a set of formulas in the language of M, i.e., we are interested in 
studying the orders of M, Mi in the presence of the additional structure of 
the expansion. 

(4) M+, M)*" expand M, Mi respectively so that M+ ^ M(( \= T and {M((,A) 
has enough set theory for trees. 

(5) We may refer to the components of s as M®, A®, etc. for definiteness. 
When T = Th{M), M = M+, Mi = M^f, or A is the set of all formulas 
ip{x, y, z) in the language of T which satisfy 0 : 2 ) — (4), these may be 
omitted. 

Remark 1.3. The identities of M'^ and Mi are not essential to many arguments. 

Definition 1.4 (The cardinals ps, tg and the cut spectrum, [5] Definition 2.8). For 
a cofinality spectrum problem s we define the following: 

(1) Or(s) = Or(A®, M®) 

(2) C'’*(s) = {(ki, K 2 ) :/or some a GOr(s), (Aa, <a) has a {^ 1 ,^ 2 )-cut}. 

Note that the are infinite. 

(3) Tr(s) = {Ta : a G Or(s)} = Tr(A^ Mf) 

(4) C**P(s) = {k : K > Ho, a G Or(s), and there is in the tree Ta a strictly 
increasing sequence of cofinality k with no upper bound } 

(5) Let tg be minC*'’P(s) and let pg be min{K : (ki, K 2 ) G C'’*(s) and k = Ki-\-K 2 }. 
A key role will be played by C(s,tg), where this means: 

(6) For A an infinite cardinal, write 

C(s, A) = {(ki, K 2 ) : Ki-I-K 2 < A, (ki, K 2 ) G C‘’*(s)}. 
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By definition, both tg and pg are regular. The main engine of the paper [8] 
was the following theorem, proved by model-theoretic means. Note that it entails 
fs ^ Ps- 

Theorem A ([S] Theorem 9.1). For any cofinality spectrum problem s, C(s, tg) = 0. 

Discussion 1.5. We now resume the discussion following Definition o In [g, 
Cartesian products were used in two ways. First, we needed the simple existence 
of Cartesian products of pairs of elements of Or(s), with no restrictions on the 
ordering of the pairs other than: (i) pseudofiniteness and (ii) the property that 
if da, db are nonstandard then so is daxb (call such a product nontrivial). This 
was needed for the basic arguments connecting behavior across all orders: notably, 
establishing existence of the lower cofinality function. To rule out symmetric cuts, 
we needed only to be able to take the Cartesian product of an order with itself. 
For the main lemma ruling out antisymmetric cuts, we needed (a) the existence 
of a and a' such that a is coverable as a pair by a' (see below), and then (b) the 
existence of the nontrivial product a x a x a x a' x a' x a'. One may take as a 
definition of “coverable as a pair” its key property. Corollary 5.7(a) of [S] [quoted 
here with the assumptions of nontriviality made there explicitly added in]: 

(**) there is a S with a < and a not a finite successor of Oa, such that the 
Godel codes for functions from [0,a]a to [0, a]a x [0, a]a may be definably 
identified with a definable subset of whose greatest element is < c?a' • 

For property (**), it suffices to have a G Or(s) such that the order on a x a is given 
by the Godel pairing function and daxa is nonstandard, by the arguments of [5]. 
We will give some alternate sufficient conditions in Section]^ 

The following summarizes our conventions. 

Convention 1.6 (Key conventions on CSPs). 

(a) Recall that definable means in the sense of unless otherwise 

stated^ 

(b) Recall that for Ta G Tr(s), rj G Ta implies that \g{r]) < da, and we have 
closure under eoncatenation, i.e. i/lg(ry) < da and a G Aa then rj^ia) G Ta- 

(c) When T is a definable subtree ofTa, we will write 

(T, <a) or just (T, <) to mean (T, <ia \t) 

(d) When p is a sequence of n-tuples, t < lg{ri), and k < n, write r](t,k) for 
the kth element ofr]{t). 

(e) Generalizing [8], we use “internal map” in the present paper for any map 
definable in , not necessarily an element of some T G Tr(s). 

(f) We call a definable, discrete order pseudofinite when every nonempty, bounded, 
definable subset has a first and last element. 

(g) We call a G Or(s) nontrivial when da is not a finite successor of Oa, and 
we call s nontrivial when at least one a G Or(s) is nontrivial. 

^the main exception being that the elements of Or(s) are a priori required to be A-definable; 
this is relaxed if s is hereditarily closed, defined below. 
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1.1. New definitions: weak and hereditary CSPs. We now give some new 
definitions weakening and extending CSPs looking towards applications. 

First, as regards applying CSPs it will be useful to keep track of whether or not 
the assumption on closure under Cartesian products is needed. For example, in 
dealing with a CSP arising from a model M = M+ = whose domain is linearly 
ordered, it may be that we care primarily about cuts occurring in the linear order 
dom(M). Thus, we introduce ‘weak’ CSPs in Definition 1.7 and in the present 
paper, use them where possible. 


Definition 1.7 (Weak CSP). 

omitting the requirement that Or(s) be 
5) + (6). 

(2) For s a weak CSP, a G Or(s), let Fa = Fa,s = {a S Xg, : a <a da}- 

Second, in [5] Convention 5.1 we had observed that CSPs have available an 
internal notion of cardinalityj^ In the present paper, we use the more general 
definition: 


(1) Call s a weak CSP if it satisfies \1.2\ 
closed under Cartesian product, 11.It 


Definition 1.8. Let s be a cofinality spectrum problem. Whenever A, B are defin¬ 
able subsets of Ml (with parameters), we write 

1^1 < \B\” 

to mean “there exists an -definable partial 1-to-l function h with A C dom(/i) 
and range(/i) C B”. Likewise, we write 

“lAI < \B\” 

to mean “(|A| < |i3|) A < |^|)/’ be. |f 1| < |i?| and there does not exist an 

-definable injection from B into A. 

Third, while the definition of CSP carefully lays out the ’canonical’ orders and 
trees, it is natural to add some internal closure conditions, stating essentially that 
objects which are internally isomorphic to canonical ones also count. 

Definition 1.9. Let s be a CSP or weak CSP. 

(1) We call b a pseudo-order of s and write b G PsOr(s) when it satisfies all 
of the requirements on elements of Or(s) from Definition in the case 
where A is the set of all formulas in the language. (The point is that 
possibly the formulas defining it are not from Ag.) 

(2) Given b 2 G PsOr(s)j we say bi is a suborder of h 2 and write bi G Sub(b 2 ) 
when: bi G PsOr(s)^ C as linear orders, and there is d <b 2 d \^2 

^which a priori need not satisfy all properties of cardinality. There it was required that the 
function be an element of the tree T^xb- Depending on the amount of set theory available in 
the present weakening is an a priori loss in definability; when functions are required to belong to 
a definable tree, we are always able to quantify over them, whereas in the definition below the 
quantification over all such functions may be strictly informal (not first order). 

^In particular, it must have an associated, definable tree, with definable length functions and 
concatenation, and so forth. 
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and r] G Tb^ with maxdom(77) = d = c?bi which lists (c S : c <bi dbi) 
in increasing orderj^ 

Definition 1.10 (Hereditary closure). Let s be a CSP or weak CSP. 

(1) Let bi,b 2 S PsOr(s). We say if,g,h) is an accurate isomorphism from 
bi onto b 2 when it respects both the order structure below db; o.nd the tree 
structure, that is: 

(a) f is a one-to-one mapping, definable in , from to Xbj 

(b) g is a one-to-one mapping, definable in , from {a : a <bi dbi} 

onto {a : a <b 2 dba}, such that a <bi c <bi dbi ^(a) <b 2 

g{c) <b2 *^b2 • 

(c) h is a one-to-one function definable in from 7bi onto Th^ such 
that 

1 Kv) <rb 2 Hv) 

and g = v"'{a) in bi iff hirf) = h{v)^{f{a)) in b 2 . 

(2) Call s hereditary i/Or(s) is closed under Sub and accurate isomorphism. 

(3) Say '^2 is the hereditary closure of Si ” when Si,S 2 are the same except that 
Or(s 2 ) is the closure o/Or(si) under members o/Sub and under accurate 
isomorphism. 

Observation 1.11. If s is a weak CSP then so is its hereditary closure. 

Observation 1.12. As a consequence of Definition \l.t^ 3), ifs is a weak CSP which 
is hereditarily closed, then for any a £ Or(s), any X C 1)^ and any d G Xr\ [Oa, da], 
there is h G Or(s) with Xb = X, <b=<a( X, and d = db- 


2. CSPS WITH EXPONENTIATION 

A feature of CSPs is that one can always develop a certain amount of Peano 
arithmetic internally, as in [S] §5. That observation motivates the main definition 
of this section, ‘closure under exponentiation.’ In this section we work out that 
CSPs of this kind have the very nice property that ps = ts- For context, recall that 
the main theorem of [S] that C(s,ts) = 0 only implies that tg < ps- For the other 
direction, it’s natural to try to show that a K-indexed path through some T with 
no upper bound translates to a (k, K)-cut in some a G Or(s). The problem is that 
the natural translation produces a definable, discrete linear order which contains a 
(k, K)-cut but is not necessarily a member of Or(s). After explaining the problem, 
we will propose the solution. 


Hypothesis 2.1. In this section, unless otherwise stated, s is a weak CSP. For 
transparency, we assume s is hereditary, i.e. closed under Sub and full internal 


isomorphism. We retain the notation Fa from 1.7 


®So e.g. bi ^ Sub(b 2 ) when Xbj is an initial segment of Xb 2 and db 2 < ™ax(Xbi), since 
there is not enough room for the list. 
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Definition 2.2. (Flattening the tree, c.f. [8] Lemma 6.2) Let a G Or(s) be given. 
We define the following linear order. Fix in advance two distinct elements of Xi^; 
without loss of generality we use Oa, la, called 0, 1, so 0 <a 1- Let be the set 
Ta X {0,1}. Let <s^ be the linear order on Sa defined as follows: 

• If c = d, then {c,i) <s^ (dj) iff i <a j 

• IfcOad and Cyl d, then (c, 0 ) < 5 ^ {d, 0 ) < 5 ^ (d, 1 ) < 5 ^ (c, 1 ) 

• If c,d are c-incomparable, then let e G Ta, ric,nd G Sa be such that e = 
cis(c, d) is the common initial segment and e^Uc <ia c and e^Ud <ia d. Nec¬ 
essarily He ^ nd by definition of e, so for s,t G {0,1} we define 

(c, s) <s^ (d, t) Uc <a nd 

For each given a, we refer to this ordered set {Sa,<Sa) constructed as “the 
order given by flattening the tree Ta ”. 


Convention 2.3. For the remainder of this article, given s and a G Or(s), let 
(5a, <Sa) denote the order constructed in 2.2. 


Fact 2.4. Let s be a weak CSP. If bl G Or(s), Ta witnesses treetops and (5a, < 5 ^) 
is the order given by flattening the tree Ta then (5a, <Ss,) das a {is,ts)-cut. 


Proof. The proof when s is a CSP is [ 8 ] Lemma 6.2. No assumptions are made 
about closure under Cartesian products in that proof, so the identical result holds 
for weak CSPs as well. □ 


We cannot a priori conclude from Fact 2.4 that (tg, tg) G C(s, tg), because we have 
not shown that 5a belongs to Or(s). However, note that (5a, < 5 a) is a definable 
discrete linear order with a first and last element, since: 


Observation 2.5. For any weak cofinality spectrum problem s and a G Or(s), there 
is an internal order-isomorphism between an initial segment of (5a, < 5 ^) ^a- 

Proof. Let (cq, : a < da) be the sequence of elements of Ta corresponding to func¬ 
tions which are constantly Oa, listed in increasing order: this sequence is linearly 
ordered by Oa- By the definition of 5a, we have that ({(cq,0) : a < da}, <a) is an 
initial segment of (5a, <Sa)- Moreover, it is isomorphic to (Fa, <a) via the internal 
map Igj, from Definition [ 137 ). □ 

Definition 2.6 (Closed under exponentiation). Let s be a weak CSP. We say s is 
closed under (simple) exponentiation when for every nontrivial a G Or(s) there is a 
nontrivial b G Or(s) such that (Xb, <b) o.nd (5a, <5^) internally isomorphic. 


Definition 2.7. For s a weak CSP, it will also be useful to define: 

(a) s is strongly closed under exponentiation, or has strong exponentiation, 
when: for every a G Or(s) there is h G Or(s) such that (5a, <Sa) clccu- 

rately isomorphic to (X^ \ db, <b), following Definition 1.9 ^ 


^recall that X a is a discrete linear order with first element, so Oa, la have the natural meanings. 
^In Definition 1.9 accurate isomorphism of two linear orders bo,bi involves an isomorphism 
of sets plus an order-isomorphism below the bounds dy,.. For these purposes, consider the d for 
Sa to be maxSa. 
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(b) s is weakly closed under exponentiation, or has weak exponentiation, when: 
for every a G Or(s) there is h G Or(s) such that (^bi <b) o-nd (5a, < 5 ,^) 
are internally isomorphic and (Yb, <b), (Ya, <a) are internally isomorphic. 


Discussion 2.8. The phrase has exponentiation” clearly covers 2.6 2.7 [a) and 


2.7[6). One of the issues raised by 2.7 is whether (5a, < 5 ^,) may map onto Xb in 


such a way that dh is not above the range of the map. To distinguish \2.6\ from \2.7\ 
we will say “simple exponentiation. ” 


Corollary 2.9. Let s be a weak cofinality spectrum problem which has exponenti¬ 
ation, a€ Or(s). Then: 

(1) (5a, <5a) a discrete linear order in which every nonempty definable subset 
has a first and last element. 

(2) There zs b G Or(s) so that (Xb,<b) has a (ts,ts)-cut. 


Proof. (1) This is inherited from the order-isomorphism to an element of Or(s). 

(2) Let Ta witness treetops. By Fact 2.4 the order (5a, < 5 „) has a (is,is)-cut. 
Given b G Or(s) such that (5a, <5^,) is order-isomorphic to Xb, clearly (Xb,<b) 
has a (tg, ts)-cut. □ 


We arrive at a fact which will be useful throughout the paper: if s has exponen¬ 
tiation then ps = is and ‘the first cut is symmetric’. 


Theorem 2.10. 

(1) Let s be a weak CSP with exponentiation. Then ps < is • 

(2) Let s be a CSP with exponentiation. Then ps = is- 

(3) Let s be a CSP with exponentiation. Then 

is = min{K : ( k , k ) G C‘’‘(s)} 

and the first cut in C‘’*(s) is necessarily symmetric, that is, if 
pL = min{K -I- A : (k. A) G C‘’‘(s)} 
then (p, p) G C‘’*(s). 


Proof. First we prove (1). Corollary |2.9[ 2) shows that if is = k, then {k, k) G C‘’*(s), 
so ps < K -I- K = K. Thus ps < is- 

When in addition s is a cofinality spectrum problem the analysis of [ 8 ] applies. 
By Theorem 00 above we have that C(s,ts) = 0 , thus is < ps, proving ( 2 ). 

For (3), the proof of 2.10 shows that ps = minjit : {k, k) G C‘’*(s)}. Since ps = is, 
this is sufficient. □ 


However, as we will see in Theorem 5.3 the situation for the local versions of 
these cardinals. Definition |5.1[ is more subtle. It would be interesting to explore 
this further. 
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3. On bounded arithmetic 

In this section, working towards our first main application in we set up CSPs 
and weak CSPs arising from models of PA or BPA and check when they are closed 
under exponentiation in the sense just described. 

Definition 3.1. A formula is called bounded if all of its quantifiers are bounded. 
By BPA we mean bounded Peano arithmetic, that is, the restriction of the Peano 
axioms eontaining induetion only for bounded formulas. 

When working with models of PA or BPA, we will use the notation in accor¬ 
dance with: 


Fact 3.2. (Gaifman and Dimitracopoulos [3], see m §1-1) Let JAq denote basic 
arithmetic with bounded induction. There exists a Aq formula ip{x,y,z), which we 
denote by x^ = z, which can be shown in IAq to have all the usual properties of the 
graph of exponentiation except for the sentence 


'ix'iy3z{x^ = z). 


Regarding Definition 3.3 we will focus on SajiV] for N a model of PA or BPA. 


Definition 3.3 (Some canonical weak CSPs from models). Let N |= BPA or 
N \= PA, and £ = 2, 3. We define s = sg[N, D]. Omitting D means D = N. 

(0) D is an initial segment of N closed under addition. D is nontrivial if it 
has a nonstandard member. We require that: 

(a) If £ = 2, then d G D implies that N \= {yx){x‘^ exists ). 

(b) The case £ = 3 is covered in (2)(c). 

(1) A — As is either: 

(a) in the case of BPA, the set of all bounded formulas, or 

(b) in the case of PA, the set of all formulas ip{x,y, z) with£(x) = £{y) = 1, 
which sato/^ [LT] (l), (2), (4),(7). 

(2) a S Or(s) when the data of (Aa, <a) is internally isomorphi^ to some 

(Aa, <a, 71) which Satisfies: 

(a) the set of elements of is a A-definable bounded subset of N. 

(b) <a is a A-definable linear order on Aa 

(c) da G Aa, and ({d : d < da},<a) is an initial segment of N with the 
usual order. 

• If £ = 2, we require that daG D. 

• If £ = 3, we require that da G D and |Aa|'^‘‘ exists. 

(d) l~a is defined and satisfies the conditions from 0 and its defining 
formulas depend uniformly on the the formula defining Aa. 

(3) Write D] to indicate that we close the set of orders of s[N,D] un¬ 
der taking Cartesian products, where daxb is understood to be nontrivial if 

da, db o,re, and that the order on at least one of the pairs is given by the 

Gddel pairing funetion. 


’recall that as the set is listed with its order, this means: internally order-isomorphic. 
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For use in later papers, we record here: 

Definition 3.4. In the context o/ |3.31 suppose f is a nondecreasing function with 
dom(/) = N and range(/) Q {I : I an initial segment of N }, such that: d G /(a) 
implies that a‘^ exists in N and whenever a is nonstandard, f{a) contains some 
nonstandard d. Define s[N, /] by requiring that for each a, 

(a) da < /(inax(Xa) + 1), and 

(h) /(max(Xa) + 1) = J implies dg, G I. 

Let us also give a name to a recurrent assumption. 

Definition 3.5 (Reasonable models). We say N |= BP A is reasonable when a G N 
implies that {a" : n a standard integer } is a bounded subset of N. 

Claim 3.6. Let N ^ BPA. 

(1) If N is Hi-saturated or just recursively saturated, then N is reasonable. 

(2) N is reasonable iff N is a candidate in the sense of \4.^ below. 

(3) If Di is a reasonable initial segment of N then D 2 = cl{Di,N) := {a G N : 
for some d G Di and standard n, N \= “a < d" ” } is also reasonable. 

(4) If D is an initial segment of N then c\{D,N) is closed under products. 

Proof. (1),(2),(4) are immediate. 

(3): Let 02 G D 2 and n G N he standard. Let di G D 2 and m standard be 
such that TV ^ d 2 < (di)™. We define xg by induction on i < n ■ m as follows: 
xq = X, Xg = Note that {xg^^ exists by the assumption on Dg. So Xnm is 

well defined. Since 

xd2 < ^ (2;di)di . . . < xr,m 

where the dots • • • indicate the multiplication has m terms, x‘^'^ exists. □ 

Observation 3.7. If N \= BPA and s = s^[iV,D] for i G {2,3} then s is a 
hereditary weak CSP. 

Claim 3.8. Let N ^ BPA and suppose that for n, d G N we have that n‘^ exists. 
Then the tree of functions from d to n is definable in N, by bounded formulas. 
Specifically, the operations from &) for the tree of sequences of length d into 
([0,n],<^) are all definable by bounded formulas. 

Proof. For compatibility with |l.l[ we denote [0, n] by Xg and d by dg. Let T denote 
the sequences of elements of Xg of length < dg. First we show that for each rj G T 
there is c G which is a code for rj (and that this is uniformly and boundedly 
definable). This applies the long known fact that Godel coding may be carried out 
in BPA; we sketch a proof for completeness, following the method of Wilkie-Paris 

M- 

We use R-adic coding (for B = 2), representing each element of as a word in 
the finite alphabet {0,1}. (This ignores the empty word, which could be accom¬ 
modated by using a different hnite alphabet or B = 3.) Since for each Pg or Sg we 
will be coding sequences of elements of uniformly bounded length, we don’t need a 
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separate symbol to indicate a transition between codes for distinct elements. Let 
Igd(ai) denote max{£ : 2^ < x}, the dyadic length. 

By|3;3]:2), we may assume every element of Or(s) is isomorphic to a canonical 
one, i.e. to a S Or(s) where: 

• [0, max(Xa)] 

• <a agrees with the order of N restricted to 

• da is such that (maxXa)'^'^ exists, 

which is equivalent to: (3n)(|Xa| < 2" < 2|Jfa|)A “ 2”'^® exists”. 

• (3n,m)(da < 2"* < 2da A |3fa| < 2" < 2|Afa| and 2"'^"* exists) 

• so w.l.o.g. da = 2^, |Xa| = 2". 

For an element a of Xa, let rep 5 (a) denote the i?-adic representation of a of 
length exactly n + 1, padded with zeros if necessary (this is possible by the choice 
of n). In the expression below let “2"* -|- rep 3 (a)” mean in base 2, so this will 
effectively move repg (a) (which is a sequence of length < n) over m spaces. 

Let (pcode{x,i,b) mean: 

• a: < 2”-2”+' 

• i < da 

• b < maxXa 

• (3a:ia;2)(a;i''a;2<ia;Algd(a:i) = (n+l)iAlgd(a:2) = n-|-lAa:2 = 2”+^-|-rep5(6)) 


Informally, ipcode asserts that x is the code for a sequence, thought of as consisting 
of no more than da consecutive blocks of length n + 1 (leaving one extra space for 
the coding of Sa in the proof of Claim 3.91, the (z + l)st of which is iepg{b). 

As written several values of x may code the same sequence; we may avoid this 
by restricting to x such that no y < x codes the same sequence. 

Then for any given a S Or(s), for our fixed values of n,TO, we may naturally 
represent 7a by 


Ta = {x ■. X < 2"’'^ ^ , (3z < n) (Igd(x) = (m + 1) • z) 


and (Vj < z)(3a:o,xi < x){xq'~' xi <ix and 2™ < xq < 2"* + 2"’)} 


Since we have fixed the values of Xa (thus, of max(Xa)) and da, we can easily build 
on Ipcode to find bounded formulas defining: the partial order on elements of T by 
initial segment, length, concatenation, and value of the function at a given element 
of its domain. □ 


Claim 3.9. Let N |= BP A he reasonable and suppose that s = S 3 [X, H]. Then s 
has simple exponentiation. 

Proof. Recall that to say s has simple exponentiation means that for every a S 
Or(s) there is b S Or(s) such that (Xb, <b) and (5a, < 5 ^) internally isomorphic. 
Weak exponentiation adds that also (lb, <b), (la, <a) are internally isomorphic. 

Let a S Or(s) be nontrivial. By construction of S 3 , we may identify a with 
its “canonical” isomorphic image, so assume Xa is an initial segment of N with 
the usual order. We will show that the hypothesis that iXal"^® exists, i.e. that 
(max(Xa))‘^“ exists, already ensures weak exponentiation. 
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As s = S3{N), there is b G Or(s) so that (Xbj<b) is internally isomorphic 
to ([0,n*],<^) and this isomorphism takes db to d* and 7b to %. Then % is 


boundedly definable by Claim |3.8| Continuing in the notation of that proof, to 
code the tree consisting of 5a = 71 x { 0 , 1 }, define / as follows: 

if ^ = (E.<ig(.) ih + 2™) • 2(-+i)b i) , i G {0, 1}, 
then f{x) = + 2 ”^) • 2 (™+i)* + i. 

recalling that we have left one unit of space by arranging our coding into blocks 
of size n + 1. Let tptode ~ range(/), which is definable by a bounded formula. 
If xi,X 2 G 5a then xi <s^ X 2 iff f(xi) < f{x 2 )- This proves that (5a, < 5 ,,,) is 
order-isomorphic to an initial segment of N. 

Let n* = maxrange(/). Since N is reasonable, there is some nonstandard d* G 
N such that exists. Applying Claim 3.8 once more, we have a tree % 

of functions from d* to [0, n*] which is definable by bounded formulas. By the 
definition of S 3 {N), there is b G Or(s) with Alb internally order-isomorphic to 
[ 0 ,n*] under the usual order so that the image of db is d*. 

This proves s has simple exponentiation. 

If in addition exists, let db = da. Then the same internal order-isomorphism 

takes lb to Ta, and s has weak exponentiation. This completes the proof. □ 

Claim 3.10. Suppose N ^ BPA, N is reasonable and s = S 3 [Af, 71]. Then s is a 
CSP. 

Proof. As s is a hereditary weak c.s.p. there are two potentially missing conditions, 
[^5)-(6). 

Let nontrivial a, b be given. By definition of S 3 , we may assume that X^, X\^ are 
internally order- isomorphic to initial segments [0,na], [0,nb] of N respectively (so 
in what follows we identify Xa^X^ with these images). Without loss of generality, 
na < Rb- Let Pr : A^ X A^ —>• A7 denote the pairing function (a;, y) >->■ (a:-by-I-1)^ -I-a:. 
Consider the set Xaxb = {Pr(a:,y) : x G Xa,y G X^} C [0, (ria + Ub + 1)^]- Then 
Pr is an isomorphism from Xa x Alb onto an initial segment of N which we call Xc- 
Let <c=<^ be the usual order. Let the order <axb be such that Pr is an order- 
isomorphism from (Aiaxbj^axb) onto (Xc,5c)- Note thal[^ this pairing function 
satisfies 0 : 6 ). 

Let n* = max(A'c). As we assumed N is reasonable, there is some nonstandard 
d* such that (n*)'^* exists. Let dc = d*. Now existence of the tree Tc is by Claim 
Recalling the closure under isomorphism from 3.3 ]2), the product a x b is 


3.8 


indeed a nontrivial element of s. Thus [LT| (5) holds, which completes the proof. □ 

Conclusion 3.11. Assume N |= BPA, N is reasonable and s = D). Then s 

is a cofinality spectrum problem with exponentiation, and so Theorem \2.10\ applies: 
Ps ~ Is • 


®An independent proof that |l.l| 6) will be satisfied on some pair, assuming only that the c.s.p. 
is weak and that cardinality grows [which will be true in any such N] is given in the next section. 
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4. Saturated models of Peano arithmetic 


We now apply the above analysis to cuts in models of Peano arithmetic. 

Theorem B. (Pabion, 1982 [T3]) Let A > Hq and M he a model of PA. Then M 
is X-saturated iff {M, <) is X-saturated. 

Theorem C. (Shelah, 1978 [1^1 Cor. 2.7 pps. 337-341) 

(1) If TX is a regular ultrafilter on X sueh that M^/P is X'^ -saturated for M 
some model of linear order, then /P is 1-atomically-X'^-saturated for 
any N in a eountable language, i.e. X'^-saturated for types consisting of 
atomie formulas e.g. x < a, h < x. 

(2) Hence ifT has the striet order property it is maximal in Keisler’s order. 

Pabion’s theorem may be derived from the proof of Shelah’s theorem just quoted. 
It was known that Keisler’s order had a maximum class, so to show maximality of 
linear order, it sufficed to show that realizing types in the language of linear order 
(in some ultrapower) ensured realization of types in some given maximal theory, 
such as PA. The proof of Theorem [C] shows that in some language expanding linear 
order, the types of the given theory may be coded in such a way that omission 
of a type corresponds to a cut in a linear order; the point as regards Pabion’s 
theorem is that this coding argument does not rely on ultrapowers except insofar 
as ultrapowers commute with reducts, and so may be carried out in any model of 
Peano arithmetic. 


Observation 4.1. For M a model of linear order ( < ) and uncountable X, M is 
1-atomically X-saturated iff 0i 92 > X whenever M has a cut of cofinality (0i,02) 
and 9i -\- 62 > Hg [equivalently, > 2, since we may have a (1, l)-cut). Usually, we 
ean omit the “1-atomically,” as e.g. in the order reduct of a model of PA or in 

Th{q,<). 


In Observation 4.1 note that if we use x < y, then min{0i,02} > but then 
an [9i, l)-cut does not give incompactness. 

The present results are an improvement in two respects. First, we can restrict 
to the case 9i =92, i.e. symmetric cuts. Second, our results are for bounded Peano 
arithmetic, not just PA. 


Definition 4.2. Call N a candidate model when N is a model of bounded Peano 
arithmetie [with no last element) which is reasonable, i.e. such that for any a G N 
there is a nonstandard d sueh that a'^ exists. We eall s a candidate c.s.p. when 
s = S 3 [A^] for a reasonable N. 

To connect to saturation, we bring in a definition from [8]. 

Definition 4.3. ([5] Definition 3.41) Let s be a eofinality spectrum problem and X a 
regular cardinal. Let p = p[xo,... Xn-i) be a consistent partial type with parameters 
in . We say that p is a Or-type over if: p is a consistent partial type in 
and for some ag,... a„_i G Or(s), we have that 

P b /y “Xi G Xg,. ” 

i<.n 
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and p is finitely satisfiable in x • • • x Xa„_i. We say simply that is X- 
Or-saturated if every Oi-type over over a set of size < X is realized in . 
Finally, we say that s is X-Oi-saturated if is. 

Claim 4.4. ([S] Claim 3.43) Let s be a cofinality spectrum problem. If k < 
min{ps,ts} then s is -Oi-saturated. 

Remark 4.5. Since by our definition any a S Or(s) has a maximum element, 
Or-saturation does not a priori guarantee that the cofinality of the model is large. 

Observation 4.6. For a model N of PA, the following are equivalent: 

(1) N is X-saturated. 

(2) ci{N) > A and N is boundedly X-saturated, that is, N \< a is X-saturated 
for every a G N. 

Proof. It suffices to prove (2) implies (1). Given a type p{x) of cardinality < A, 
write p{x) = {(pi{x,di) : i < A}. Since cf(iV) > A there is some a* G such 
that p{x) U {a; < a*} is finitely satisfiable. Let 6* = 2“*. Now for each i there 
are Ci < 6* and ip'fix,y,bfi) which is 5*-bounded [meaning that all quantifiers are 
of the form (3z < h„) or (Vz < &*)] and N |= fix){ipi[x,di) = pl{x,Ci,b„)). Let 
p"{x) = {p'fix, Ci, bt) A x < : i < A}. This is a finitely satisfiable type in N [<;,^. 

Its realization implies realization of p, and it is realized by hypothesis (2). □ 

Theorem 4.7. Let N be a model of Peano arithmetic and X an uncountable cardi¬ 
nal. If the reduct of N to the language of order has cofinality > X and no {k, K)-cuts 
for K < X, then N is X-saturated. 


Proof. We may assume TV is a nonstandard model. Hence it follows that N is 
reasonable in the sense of |3.3[ i.e. a G N implies that {a" : n a standard integer } 
is a bounded subset of N. (If not, cf(TV) < A.) 

""" " ’ ■ ""sisa csp 


Assume cf(A^) > A. Let s = s^^N) be from 3.3 By Conclusion 3.11 


with exponentiation. Thus Theorem |2.10| applies and ps = tg. By Claim 4.4 and 
s is min{ps, tg, cf{N, <)}-saturated. If tg > A, we finish, so assume 


Observation 4.6 


that tg < A. By Theorem 2.10 there is a G Or(s) whose contains a (is,ts)-cut. 
Recall from Definition 3.3 that since s = S 3 (AT), for each a G Or(s), (Xa,<a) is 
internally order-isomorphic to an initial segment of N with the usual order. Then 
N has a (tg,tg)-cut, which completes the proof. □ 


Theorem 4.8. Let N be a model of BPA which is reasonable, i.e. for every a G N 
the set {a" : n G N finite } is bounded. Then the following are equivalent: 

(1) for every n* G N, the model N^n, = N [ {a : ^ o < n*} is X-saturated. 

(2) for every n* G N, the model N<cn., considered as a linear order has no 
{k, K)-cuts for K = cf(K) < A. 


Proof. (1) implies (2) is obvious, so assume (2) holds. Let s = s^^N) be from 3.3 


Then by |3.11 s is a cofinality spectrum problem with exponentiation, and pg = tg. 

Let K = ps = tg, so K is regular. By 2.9 some a G Or(s) has a (k, K)-cut. By 
the definition of s^^N), any Xa is internally order-isomorphic to a bounded initial 
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segment of N with the usual order. Thus, some bounded initial segment of N has 
a {k, K)-cut. As we’ve assumed ( 2 ), it must be that A < k = ps = tg. 

Let n* G be given. As we assumed N is reasonable, there is a nonstandard d* 
such that N ^ exists”. Recalling |3.3[ 2), there is a nontrivial a G Or(s) such 

that (Aa, <a) isomorphic to an initial segment of A, containing [ 0 , n*], with the 
usual order. Thus, to prove (1), it will suffice to show that every a £ Or(s) is 7 +- 
Or-saturated for every 7 < A. By 4.4 if 7 < min{ps, tg} then s is 7 +-Or-saturated. 
Since A < pg = tg, this completes the proof. □ 


Note that Theorems 14.71 and l4.8l show that the situation in models of Peano arith¬ 
metic is very different from that in real closed fields, as shown by the next quoted 
theorem. By “asymmetric cut” we mean a cut in which the infinite cofinalities of 
each side are not equal. 


Theorem D (Theorem 1.1 of Shelah [21)1. Let K be an arbitrary ordered field. 
Then there is a symmetrically real closed field containing K such 

that any asymmetric cut of K is not filled. So if K is not embeddable into K, then 
K'^ and K necessarily have an asymmetric cut. 


5. On THE LOCAL CARDINALS pg,a AND ig^a 
Returning to CSPs generally, in this section we prove Theorem |5.3[ a comple- 


The theorem shows that the local cardinals pg 


mentary result to Theorem 2.10 
and tg_a from Definition 5.1 need not normally agree, even in CSPs arising from 
models of Peano arithmetic, if the underlying is not uniformly saturated. 


Definition 5.1. Let s be a CSP or weak CSP, and a £ Or(s). 

(1) Let pg_a be min{«; : there are regular ki,K 2 such that ni + K 2 = k and Aa 
has a (ki, K 2 )-cut }. 

(2) Let tg^a be min{«: : k > Hq and there is in the tree Ta. a strictly increasing 
sequence of cofinality k with no upper bound }. 


We need a preliminary lemma. 

Lemma 5.2. Let s be a cofinality spectrum problem, a £ Or(s). Suppose (iSg, < 5 ^) 
has a {K,K)-cut, for k < tg. Then either Aa has an {K,K)-cut or else Ta has a 
branch of cofinality k with no upper bound. 

Proof. Let (a, 6) = (((ai,L) : i < k), {(bi,Si) : i < k)) witness the cut in Sa, with 
bi G Ta and ti, Si G {Oa, la} for each i < k. By definition of cut, we may assume 
K is regular. 


Step 1: Simplifying the presentation of intervals. By the pigeonhole principle, we 
may assume the sequences {U : i < n) and {si : i < k) are constant. For each i < k, 
write Aj for the closed interval in the linear order Sa whose endpoints are given by 


^*^This means that any decreasing sequences of closed bounded intervals, of any ordinal length, 
has nonempty intersection. 
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{ai,ti) and {at, \ti — 1|), and likewise for Bi. By the construction of Sg., any two 
intervals of this form are either concentric or disjoint. 

Let A = {Ai : i < k) and B = {Bi : i < k). 

The task of this step will be to prove that without loss of generality, A consists 
of either pairwise concentric or pairwise disjoint intervals, and likewise for B. Here 
“concentric” means either either concentric decreasing: j < i < k Cj A Ci 

[for C = A 01 B] 01 concentric increasing: j < i < k Ci A Cj. 

If K = Ho, then by Ramsey’s theoreirp] we may assume that A consists either 
of concentric intervals or disjoint intervals moving right, meaning j < i < k implies 
Aj n Ai = ^ and (Vcc S Aj){\ly S Ai){x < y). Likewise, we may assume that B 
consists either of concentric intervals or of disjoint intervals moving left, meaning 
j < i < K implies Bj n Bi — 0 and (Vx G Bj){'iy G Bi){y < x). 

If K > Hq, let a A b denote the maximal common initial segment of a, b G Tg. 
For this argument, we use c to denote either a or b. For each i, the sequence 
(lg£,(ci A Cj) : j G [i, k)) is a sequence of elements of Yg C Xg [recall Definition 
bounded by Igjj(ci). Thus, for some club Ei of k with minify > i, we have that 
ii := (lga(ci A Cj) : j G Ei) is either constant or <a-decreasing. Let S' C k be a 
stationary set of i on which we get the same outcome (either always constant or 
always decreasing). 

Let E = P|{e < k : e a limit ordinal and e G ni<e so if is a club of k. There 
are several cases: 

(1) First case: for all i G S, Ii is constant. 

(a) If i G S, j G Ei implies Ci A Cj = Ci, then {ci : i G S H if) is a 
<i 7 ;^-increasing sequence so we are in the concentric decreasing case. 

(b) If i G S, j G Ei implies lga(ci A Cj) < Ig(ci) then by Fodor’s lemma 
there is 7 G k and a stationary subset X of k such that i G X and 
j G Ei implies lga(ci A Cj) = 7 , so we are in the pairwise disjoint case. 

(2) Second case: for all i G S, Ii is <a-decreasing. (Remember that the 
branches of Eg are internally pseudofinite, but not necessarily well-ordered 
from an external point of view.) Let X = S D E. Then (ci : * G X) is a 
Oj-^-decreasing sequence, so we are in the concentric increasing case. 

Step 2: The concentric cases. Suppose both A and B are concentric. Then (a^ : 
i < k) and {bi : i < k) are both <ia-hnearly ordered sequences in Eg. There are four 
cases depending on whether each of these sequences is Oa-increasing or decreasing. 

(a) Suppose both {ui : i < k) and {bi : i < k) are <ia-iiicreasing. If they lie 
along eventually different branches, the original sequence (a, b) could describe only 
a pre-cut and not a cut according to the definition of 5a, so we get a contradiction. 
If they lie along the same branch, then it must be that Eg has a branch of cofinality 
K, as desired. 


1.7 


11 


This also holds if tz is weakly compact. 
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(b) If {tti : i < k) is <a-increasing while {bi : i < k) is <ia-decreasing, these and 
form a cut (*) in the linearly ordered set 

({c e 71 : c<i6o}.<) 

Then the projections ((Ig(ai) : i < K),{\g{bj) : j < k) form a pre-cut (**) in 
Xa- If this pre-cut (**) were realized, say by t, then bo \ t realizes the cut (*), 
contradiction. This shows that Xg^ has a (k, K)-cut. 

(c) If {tti : i < k) and {bi : i < k) are both <i 7 -^-decreasing, the original sequence 
(a, b) will not describe a cut, so we ignore this case. 

(d) If {bi : i < k) is <i 7 -^-increasing while {ai : i < k) is < 7 -a"decreasing, the 
argument is parallel to case (b). 

Step 3: Not both concentric. Again, there are several possibilities. 

Suppose first that neither A nor B is concentric, so A is a sequence of disjoint 
intervals moving right and B is a sequence of disjoint intervals moving left. 

Consider the sequence {ci : i < k) where Ci := lub{ai,foi} in the tree Tg. By 
definition of a and b, this sequence will be either eventually constant or a path 
through the tree Tg. 

If the sequence is a path through the tree, then ((ci, 0) : z < k) is cofinal in a and 
{(ci, I) : z < a) is cofinal in b. So the path {ci : i < k) cannot have an upper bound, 
as given any such upper bound d*, by definition of (5a, < 5^)1 would have that 
((i»,0) and (d*,l) both realize the original cut, contradiction. 

So in this case, there is a path through Tg of length k with no upper bound. 

If the sequence is eventually constant, then there is z* < k such that all {ai,bi ■ 

< i < k} are immediate successors of the same node, say a*, in Tg. So lg(a*) < 
dg. By definition of the order (5a, < 5 ^) and the case we are in, this means 

((ai(lg(ai) - 1) : z» < z < k), {bi{\g{b^) - 1) : z» < z < k)) 

is a pre-cut in Xg. Suppose for a contradiction it were realized by x; then c* := 
a*^(a;) would exist since lg(a») < dg. Then in (5a, <5^)) (c*,0) and (c*, 1) would 
both realize the original cut (a, b) , contradiction. 

So in this case, Xg has a (zt, zcj-cut. 

Otherwise, precisely one of A, B is not concentric. The cases are parallel, so 
assume the non-concentric side is B. Define di for z < k by di := lub{6i,6o} in 
the tree Tg. Writing Ci for the interval ((c^, 0), (ci, I)) and Di for the interval 
{{di, 0), {di, I)) in 5a, we have that {Ci : i < k) and both {Di : i < k) are concentric 
sequences of intervals with Di C Cj for all z » j. 

This reduces the problem to Step 2. 


Step 4-' Finish. We have shown that in each case either Xg has a {k, zc)-cut or else 
Ta has a strictly increasing path of length k with no upper bound, so this completes 
the proof. □ 
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Theorem 5.3. Let k be a regular uncountable cardinal. 

(1) Suppose we are given M a model of PA which is n-saturated, and a* € M 
nonstandard. Then we can find a countable set X C M such that letting N 
be the Skolem hull of {a G M : M \= a < a*} U X, we have that the reduct 
{N, <) to the language of order has an (Ho,Ho)-CMi. 

(2) There is a cofinality spectrum problem s with Mf = N and a € Or(s) such 
that 

ts.a ^ Ps,a 

in fact, ts_a = ^0 while ps,a > «• 

(3) If in the conditions above, we have just that M |= BP A and for some 
r* < a* nonstandard M ^ “aP* exists”, this is enough. 

Proof. First we prove (1). Let A = M f o*. 

Let {Fn : n < (jj) list the Skolem functions of M, each appearing infinitely often 
(for transparency). Let kn be the arity of Fn, and without loss of generality kn < n. 

Let p be the type in the variables z, Xi {i < oj), yi (i < to) and parameter a* 
expressing: 

(a) z < a» is nonstandard 

(b) xq = a* 

(c) yo = 

(d) m < n < u! implies = Xq < Xm < Xn < Pn < Vm ^ Do 

(e) letting Bn = {F„(eo,..., efc^_i) : € AU {x£,yi : I < n}}, we have that 

Bn n (,Xn, Pn} — 0- 

Let US check that p is consistent. By the K-saturation of M, this will suffice to 
show it is realized. 

Fix n < u) and consider a finite fragment of p f z, xq, . •., Xn, yo,..., ?/„. Let i be 
the maximal exponent appearing in conditions of the form (e). We are looking for 
r, oq, ..., On, b^,... ,bn such that 

• r is nonstandard, or simply above some given natural number 

• a* = oo < • • • < a„ < < • • • < 5o = (a*)’’ 

• m <n implies Bm H (a™, bm) = 0 

For each n, the set Bn is definable in M (since it only involves one func¬ 
tion Fn, of arity fc„) and of power c„, where c„ « (|^| -I- 2n)*" < Let 

Bn{w, Vo,..., Vn,Vo ,. ■., v'n) denote the set 

{Fn{eo,..., efc„_i) : ee<wy Ci G {uq, •. •, u„, Uq, ..., v'n}} 

which will likewise have size < w*"-(2n-|-2)''" < . Let (pn{w,Vo,... ,Vn,v'Q,... ,v 

assert that 

(Vt)(3s < • t){3a3b){a < b < s A b — a> t A (a, 6)n Bn{x) = 0) 

Then clearly for all m < n, M ^ f/wf/iNv'(pra{w,v,v'), recalling that is fixed so 
the exponential notation abbreviates multiplication. 
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Choosing r such that (fco + 2)(fci + 2) • • • (kn + 2) < r < a* and = bo = {a^^Y 
we may then choose ai, 6 i,..., a„, by induction on ^ < n such that: 

• k < i Qk < ai < bi < bk 

• {ao,bo) = (a*, (a*)’') 

• bi-ae> 

For £ + 1, we have b^ — ai > and i?(a*, Og ,..., ai,bo,..., be) is 

internally a set with < elements, so there is room. 

This completes the verification that p is consistent, therefore (by saturation) 
realized. For the remainder of the proof, fix realizations r, ai{i < lo), bi{i < ui) of 
the type p. 

[With a little more care, using for i < uj, we could alternately 

have chosen the entire countable sequence by induction, avoiding the appeal to the 
type and Hi-saturation.] 


Let N be the Skolem hull of M [ a* U {a„,5„ 
s = s[j^[7V] be the canonical CSP from Definition 3.3 


: n < w}, so N \= PA. 
. Then: 


Let 


(a) N <M. 

(b) M<a, = so (TV, <^) is saturated below a* by definition of M. 

(c) ((a„ : n < lo), {bn ■ n < 10 )) is an (Hg, Ho)-cut, because by construction the 
Skolem functions do not fill it. 

(d) Thus, if a is such that Xg^ = M<a. = and, say, dg = maxXa, then 

Ps.a ^ ^ whereas if b is such that Xi, = , and, say, d^, = maxXb, then 

Ps,b — ^0- 


This completes the proof of (1). We continue the argument to prove (2). (3) will 
follow from the proof. 

Let a be such that Xg = N<a,- Recalling the small nonstandard exponent r, 
let d* = r + 1 and consider the definable subtree T Y Ta consisting of sequences of 
length < d* of numbers < o*. T has cardinality al [the tree 7^ will be at least as 
large]. 

Recalling that N ^ PA, s is closed under strong exponentiation, so there is 
an injection from Sg into some Xg. Composing with the Godel pairing function if 
needed, we may assume there is a definable injection of Sg (as a set) into some X\, C 
N. Applying Conclusion |7.4[ we obtain a definable order-isomorphism between 
(^a, <Sa) onto an initial segment of = N. Since T is the set of all sequences 
from Xg to itself of length < da = a* » r, the cardinality of T is > a*’’ = d*, so its 
image must contain the (Hg,Hg)-cut. Because Ab has an (Hg,Hg)-cut, necessarily 
(5, < 5 ) has such a cut. 

By Lemma 5.2 either Xg has an (Hg, Hg)-cut or else Tg has a branch of cofinality 
Hg with no upper bound. Since Xg is K-saturated by assumption, we must be in 
the second case. This shows that tg.a = ^o- On the other hand, ps^a > by the 
hypothesis of saturation. □ 


Thus, the local cardinals pg.a and tg.a need not be equal, even in well behaved 
cofinality spectrum problems, if the model Mj*" is not uniformly saturated. 
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6. Characterizing the <*-maximal class 

In this section we give the first real evidence that SOP 2 is a dividing line by 
proving that, under instances of GCH, SOP 2 characterizes maximality in the inter- 
pretability order < 1 * which will be defined below. The proof uses cofinality spectrum 
problems. This answers an open question and also gives evidence for a recent con¬ 
jecture, as we now explain. The use of GCH comes only from Fact |6.2| below. 
Recall: 

Definition 6 . 1 . {SOP 2 , c.f. [21] 1.5) T has SOP 2 if there is a formula (p{x,y) 
which does, meaning that in €t there are parameters {djj : 77 S ‘^^‘ 2 ), = i{y), 

such that: 

(1) For each rj G ‘^2, the set {ip{x,drj\i) : £ < to} is consistent. 

(2) For any two incomparable r],u G “^^2, the set {g 3 {x,dT^),ipix,d,y)} is incon¬ 
sistent. 

Shelah in [T8| had defined an order on theories, a natural weakening of Keisler’s 
order: Ti < 1 * T 2 , which holds, roughly speaking, if there is a third theory T* which 
interprets both Ti and T 2 and whose models M* have the property that if the reduct 
to t(T 2 ) is saturated, so is the reduct to 'r(Ti). [See Definition |6.7| below.] This 
was studied and developed more extensively by Dzamonja-Shelah [T] and Shelah- 
Usvyatsov |24| . In the Shelah-Usvyatsov paper, building on work of Dzamonja and 
Shelah, it was shown that: 

Fact 6 . 2 . (Shelah and Usvyatsov [24| 3.15(2), under GClj^ IfT is NSOP 2 then 
T is necessarily non-maximal in <*. 

In Shelah and Usvyatsov [21] and Dzamonja and Shelah [Tj it was asked: 

Question 6.3 (Question 1.8 of |24] 1. Does <*-maximality characterize either SOP 3 
or SOP 2 , maybe both? 

Question 6.4. ([T] Question 3.1) Does SOP 2 imply <f -maximality? 

Here we settle the question, giving a positive answer: it characterizes SOP 2 . 
Now let us explain the connection to Keisler’s order which motivates this work and 
our solution. SOP 2 is a property which is not yet well understood and was not 
known, prior to the present paper, to be a dividing line. Recently, however, we 
proved the following theorem: 

Theorem E. (Malliaris and Shelah [5] Theorem 11.11) Any theory with SOP 2 is 
maximal in Keisler’s order. 

We conjecture there that SOP 2 characterizes the maximum Keisler class. In the 
current section, we give strong evidence for this conjecture by proving the result 
for the order <*, which refines Keisler’s order. 

^^This hypothesis is missing from the statement in m, but that proof quotes ^ 3.2, which 
assumes relevant instances of GCH. 



MODEL-THEORETIC APPLICATIONS OF COFINALITY SPECTRUM PROBLEMS 


23 


We now state the main result of this section: we prove that T is <i*-maximal if 
and only if it has SOP 2 (Theorem 6.14 below). In light of Fact 6.2 it suffices to 
prove that any theory with SOP 2 is <i*-maximal. Since < 1 * refines Keisler’s order, 
even though it is not known whether it is a strict refinement, it is not sufficient to 
quote Theorem rather, we use the technology of cofinality spectrum problems 
developed for the proof of Theorem 1 

Given this result, it is natural to try to say more about the dividing line at 
SOP 2 , which we do in pi 


Convention 6.5. Throughout this section T denotes a complete countable first- 
order theory. 

We now review the “interpretability order” <*, introduced in Shelah [18] Defi¬ 
nition 2.10 as a natural weakening of Keisler’s order. We first need a definition of 
“interpretation.” 


Definition 6 . 6 . (Interpretations, c.f. ^ 1.1) LetTo andT^. be complete first-order 
theories. Suppose that 

T = {tr^r) • R ® predicate or function symbol of t{Tq), or =) 
is such that each ipnixfi) € f(T*). 

(1) For any model M* |= T*, we define the model N = as follows: 

• N is a t(Tq)- structure 

• dom(A^) = {a : M* |= ip={a,a)} C M* 

• for each predicate symbol R of t(Tq), = {d : M* \= ipR\d]] 

• for each function symbol f of t(Tq) and each b G N, N ^ “f(a) = b” 
iff \= (pf{d,b), and \= “(pf{d,b)A(pf{d,c) => b = c”. 

Note that by the last clause, we may restrict to vocabularies with only pred¬ 
icate symbols. 

(2) Say that Tp is an interpretation o/Tq in T* if: 

• each (fiiiixr) G 

• for any model M* \=T^, we have that ^ Tq 

(3) If there exists Tp which is an interpretation ofT^ in T„, say simply that 'T* 
interprets Tq . ” 


Definition 6.7. (The interpretability order <*, c.f [T| 1.2) 

(1) Let Tq, Ti be complete first-order theories and A an infinite regular cardinal. 
We say that Tq Ti if there exists a theory T* such that: 

(a) T* interprets Tq, witnessed by Tp^, and Ti, witnessed by Tpl, where 
“interprets” is in the sense o/ |6.6| 

(b) For every model M* ^ T*, if is X-saturated, then is 

X-saturated 

(2) We say that Tq <* Ti z/Tq <1^ Ti for all large enough regular X. 

Discussion 6 . 8 . Definition |6.7| is stated for regular cardinals, but it also makes 
sense for singular cardinals. 
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As ultrapowers commute with reducts and the choice of index models is irrele- 
vanlp^ clearly <*-equivalence refines <-equivalence [equivalence in Keisler’s order], 
A priori, one would expect that <* is much weaker but this is not known to be the 
case. In fact, the known Keisler classes (i.e. of stable theories) coincide with those 
for by [18] 2.11. 

We will use a result parallel to that familiar from Keisler’s order: 

Fact 6.9. (Shelah |18] 2.11 p. 23) Any theory with the strict order property is 
<f -maximal \i.e. -maximum]. 

Claim 6.10. Let s be a esp so ps = tg. Suppose a G Or(s) has a {ts,is)-eut. Then 
Ta witnesses treetops. 

Proof. (Included for completeness, this argument simply adapts the proof of |8] 
Lemma 6.1, which proved that in this case T^xa witnesses treetops, to show that 
71 witnesses treetops.) Choose a sequence ((oq : a < tg), {b^ : a < tg)) witnessing 
the cut. By induction on a < tg = pg let us choose a path through 71 satisfying 
the following. 

• for each a, Cq, belong^to the definable subtree of 71 consisting of elements 
X such that: for each n < maxdom(a:), x{n) codes a pair [i.e. is of the form 
(a -I- 6)^ -b a for elements a <a b G Ala], and if m < n < maxdom(x) and 
x{m) = (ai, 6 i) and x(n) = ( 02 , 62 ) then oi <a 02 <a< 62 <a< 61 . 

• fi < a => cp <1 c„ 

• for each a, Ua '■= maxdom(ca) 

• for each a, Ca(na) = (aa,ba}. 

The construction of this tree follows the template of [5|. At successor steps, we 
concatenate. At limit steps a < tg, we first choose an upper bound c* for the 
sequence built so far, by definition of ig. Let n* = maxdom(c*). Then since Tfa is 
pseudofinite, the nonempty, bounded set {n < o* : c*(n) = (a, b) and a <a Oq and 
ha <a 6} has a maximal element n**. Then let Ca = c* [n,,^(aa, 6 q,). 

Having completed the construction of the sequence, notice that it is unbounded 
in 71, because if it were to have an upper bound c* then either of the elements 
in the pair coded by c*(maxdom(c*)) would realize our original cut, contradiction. 
This completes the proof. □ 

We will use one further fact about trees in CSPs, which explains that Tr(s) is 
quite robust. 

Fact 6.11 ([8| Claim 2.13). //(T,<a) 'is a definable subtree o/(71,<a) and (cq : 
a < k) is a <g^-increasing sequence of elements ofT, then {c^ : a < k) has an upper 
bound in T if and only if it has an upper bound in Ta. 

^ ^Keisler [4] proved that if is a regular ultrafilter on A and M = N in & countable language 
then I'D is A'’"-saturated iff /D is A"^-saturated. 

^^Alternately, rather than asking that Ca code a pair, ask that if ti < t 2 < tz are successive 
elements of Ig(ca) then either Cci:(ti) < Ca(t 3 ) < Ca(f 2 ) or else Cct{t 2 ) < Caf-z) < Cct{ti). Then at 
limit steps, the condition is that the interval defined by (cQ(n), Ca(n + 1)) includes aa. 
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Definition 6.12. Say that a tree Ta € Tr(s) witnesses treetops if there is in Ta 
a strictly inereasing sequence of cofinality tg with no upper bound, i. e. the infinite 
minimum is attained in Ta- 


Fact | 6 . 11 | shows that if T' is a definable subtree of Ta, Ta witnesses treetops 
and there is an infinite increasing sequence in T' with no upper bound, then T' 
witnesses treetops. But there may not be such a sequence, as e.g. in the trivial 
case when T' consists just of the root. 


Lemma 6.13. Let T be any theory with SOP 2 - Then T is maximal in <*. 


Proof. Let Tq be the theory Th(uj + w*) of an infinite discrete linear order with 
a first and last element. As just explained, it will suffice to show that there is a 
theory T* with the following properties. 

For any M* ^ T, 

• there exists an interpretation of T in M*, denoted 

• there exists an interpretation of Tq in M*, denoted M* 

• for any infinite regular cardinal A, if is A-saturated 

then is A-saturated. 


We build the theory T* in several steps. Let ip{x, y) be a formula of Tj which 
has SOP 2 . Let n,p = i{y); here and elsewhere, we may omit overlines. Without 
loss of generality, T(ri) has only predicates. To begin, fix: 

• a model Mi ^ T and a set of parameters (a,, : 77 G witnessing SOP 2 
for ip. [Recall that by compactness, we may assume our tree witnessing 
SOP 2 is infinitely branching, with paths consistent and incomparable nodes 
inconsistent.] 

• a model M 2 |= ('H(Hi),g). Without loss of generality, the domains of Mi 
and M 2 are disjoint, and the relation e does not appear in r(Mi). 


Let M be the model which is the disjoint union of Mi and M 2 , expanded by the 
additional relations and functions {N, P,F} as follows and no additional structure. 
(Without loss of generality, these symbols do not occur in r(Mi) or t{M 2 ).) 
names uj in M 2 . 

• P^^ names {a,, : rj G C dom(Mi). 

• is a unary function with domain C M 2 and range P^ C Mi, such 
that F^^{r]) = a,,. 

For each n < w, let M„ be the model M expanded further by the constant c where 

I? be a nonprincipal ultrafilter on uj. Let 
iV* = Yln^n/T and let T* = Th{NT). This completes the construction of T*, the 
theory of the ultraproduct as just defined. Note that t(T*) = t(W) = t(Mi) U 
t{M 2 ) U {N,P,F,c\. In any model M of T*, the constant c^ is a nonstandard 
element of , i.e. of the (nonstandard) copy of w. 

In addition to T and W as just defined, let M* be an arbitrary but fixed model 
of T which satisfies: M* [t(Ti) is A-saturated. Note that T* interprets Tq and 
Ti, that is, there exist ^g, Tp-^ witnessing 6.6 This is because M* [i-(ri)H by 
construction, while Nq := N^* \ c^* = ({a G M* : M* ^ a G c}, G^*) \=To. 
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To analyze saturation, we define a cofinality spectrum problem as follows. First, 
let Or°(s) be the smallest set containing the set of all finite nonempty initial seg¬ 
ments of , in each case letting = maxXa- [We may use any non-empty order 
in ■H(Ho).] For each a,b € Or°(s), let a x b be the definable, pseudofinite linear 
order on x Xb given by the Godel pairing function, and let daxb = (da, db). Let 
Or(s) be the closure as just described of Or°(s) under Cartesian product, as well 
as initial segment. [If b is an initial segment of a, define db = minjmaxXb, da}.] 
Suppose for a moment that M* = TV*, i.e. suppose we are really in the case 
of the ultrapower. Then for each a G Or(s), is a formula ip{x,y,z) over the 
empty set. Because we are in TV*, for each suitable parameter a, the set (p{x,x,d) 
is contained in the ultraproduct of finite sets. Let 'ip{w, z) be such that for each 
suitable d G [though by construction, we can restrict to the case where 

d C N^"] we have that 7},,a = {y : M \= d)} is the set of finite sequences of 

members of the finite set W,^,a = {b : M \= ip{b,b,d)} of length < maxX,^_a- Let 
o = {( 77 , i/) : 77 , G Tip^a and 77 is an initial segment of v }. These are definable in 
Mn by the choice of its theory. The length and evaluation functions Ig and val can 
be defined likewise. By Los’ theorem, these formulas will define the appropriate 
trees in the ultrapower. Thus, we get a cofinality spectrum problem. Moreover, 
for each given (^a, each d of length €( 2 :), and each t < lo, we have that in each 
index model, the tree T = 7},,a[t] is finite, so its flattening {S, <s) [in the sense of 


injective order-preserving map of (S,<s) into iV”. As the flattening is uniformly 
definable from t/j, and we are in a model with sufficient set theory, such an injection 
exists also in the ultrapower and so s has (strong) exponentiation. 

Returning to the case of arbitrary M* = AT*, as we are in a model with sufficient 
set theory, note that the existence of such associated trees and injections are ele¬ 
mentary properties of each given <p and ip. Thus, also in this more general case, s 
is a cofinality spectrum problem with exponentiation. 


2.2 


above] can be injectively mapped into That is, \= “there exists an 


Having dehned s, we now prove that tg > A. First we verify that it is sufficient 
to look at one-dimensional trees, i.e. that treetops are witnessed by some Ta where 
Xa C . By Theorem 2.10 there is a (ig, tg)-cut in some Xa, a G Or(s). If Xa 
is one-dimensional, then by Claim |6.10[ we finish. If not, Xa is contained in some 
finite Cartesian power of . Let / : Xa —>■ be a definable injection, given 

by applying the Codel pairing function finitely many times. By the definition of s, 
this is an order preserving map. (This appeal to the definition is not necessary: we 
could simply use that such a map is an injection of sets, so by Conclusion 7.4 of the 
next section, there is an injective order-preserving map into some one-dimensional 
Xb.) Necessarily Xb will have a (tg,ts)-cut, so again by Claim 6.10 we finish. 

So to show ig > A, it will suffice to show that for any one-dimensional a, and any 
K < A, any K-indexed strictly increasing sequence (77^ : a < k) in 7^ has an upper 
bound. Recall the constant c from the signature of X* and M*. Since M* = X*, 
any one-dimensional Xa is contained in a nonstandard initial segment, i.e. for some 
777., j= “c < 777 and Xa C M* [ 777 ”. By Fact 6.11 without loss of generality Xa 
is the full initial segment below m and 7^ is the full tree In (7T(Ho), e)^* we 
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define 71 = (™^m, <) and let 

:= (3r? G %){F{r]) = y)) 

define the subset of corresponding to the image F{Ta). Now if 77 = {rja : a < n) 
is increasing in 71, then recalling the 5 'OP 2 -formula (p from the beginning of the 
proof, 

Pfj = {ifiix, F{r]a)) :a<K} 

is a consistent partial typ^^in M* \ t{Ti). By the assumption of A-saturation in 
that signature, some d G M* realizes p, hence 

{7 e 71 : p[d,F{r])]} 

is a subset of a branch of 71 by definition of SOP 2 and of F, and is definable in 
M*. Then the set 

{a G 77a : a < da A i3r]){rj G 71 A p[d, F{r])] A a G dom(? 7 ))} 

of lengths of such elements is a definable, nonempty, bounded subset of 77a, so 
contains a greatest element a*. Any 77 along the distinguished branch whose domain 
contains a* will be an upper bound for Tj. This completes the proof that tg > A. 

Recall that we had set Nq := \ c^* as the domain for our interpretation of 

Tq in M*. Since s is a CSP with exponentiation, pg = tg = A by Theorem |2.10[ By 
definition of pg, there are no (ki, K 2 )-cuts in any 77a, for a G Or(s) and ki, K 2 < ts- 
This in particular is true for a with 77a = {a : Af* ^ a < c} and da = max77a. 
In fact, for arbitrarily large a G , Or(s) contains a such that 77a 2 N in 
which, therefore, we have no (ki, «: 2 )-cuts. 

Finally, let us prove that i.e. the TQ-submodel whose domain is Nq, is A- 

saturated. We know that for models of Tq, every formula is a Boolean combination 
of the formulas x = y, x < y, and (pk{x,z) = {3'^y){x < y < z). Thus Nq |= Tq is 
A-saturated iff every cut (Ci, ( 72 ) of A^o 7 N^* of cofinality {ki, K 2 ) is filled, where 
Ki, K 2 are regular and ki + ^2 < A. This was proved in the previous paragraph. 
This completes the proof. □ 

Theorem 6.14 (GCH). T is <f -maximal if and only if it has SOP 2 . 

Proof. By Fact |6.2| (which assumes relevant instances of GCH) and Lemma 

7. Useful tools and additional definitions 

Before turning to a structure theory for NSOP 2 , we prove several additional 
facts about CSPs: Claim [773| and Conclusion |7.4[ which show that from a suitable 
bijection of sets, we can recover an order-isomorphism. It follows that the assump¬ 
tion that the order on all pairs was given by the Gddel pairing function in the CSP 
constructed in Lemma |6.13| could be weakened, as mentioned in that proof. Tying 

^^The fact that comparability of elements in the domain of F is reflected in the consistency of 
their images will carry over from the models M„ to AI* by Los’ theorem and from there to M, by 
elementary equivalence. 


6.13 □ 
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up loose ends, we show that one of the main consequences of |l.l[ 6) can be recovered 
in weak hereditary CSPs, Claim 7.5 and discuss the barrier to fully recovering [5] 
for such CSPs in |7.6[ Finally, we include a definition of “strong” CSPs, natural 
when the underlying model is totally ordered. 


Definition 7.1. Let b G Or(s). We say that Z C Xb is small in Xb if: 

(a) there is some definable V, Z C V C Xb such that ^ “there does not 
exist X G lb such that x is a bijection from Xb into V. ” 

(b) if Z then max(Z) < db 

When Z C Xb is small in Xb and is an initial segment, we call it a small initial 
segment. 

Remark 7.2. Condition \7.lY ^) allows for concatenation. 

Claim 7.3. Suppose we are given a weak cofinality spectrum problem s, b £ Or(s), 
h G , [W, <w) ® definable and pseudofinite linear order, and Z a small initial 
segment ofYb, such that: 

1= “ h is a partial bijection with W C dom(/i), range(/i) C Z” 

Then {W,<w) is internally order-isomorphic to an initial segment ofYb- 


Proof. Let (lF*,<w) denote the definable set h{W) C Xb with the definable 
linear order given by a: <w* U h~^{x) <w h~^{y). This allows us to 

identify {W*, <w-) definably with {W, <w), and now we prove that (W*, <w) is 
internally order-isomorphic to an initial segment of (Xb,<b)- 

Let T be the definable subtree of 7b given by (p{x), which says: “x S 7b is a one 
to one order preserving function from an initial segment of (Tfb, <b) onto an initial 
segment of {W*, <w )” ■ Thus if a <b & are in dom(x) then x{a) <w* x{b). 

First, note that the set P = {x G T : 7 >(x)} is linearly ordered. This is because 
any two elements x,x' gT must agree on the first element of their domain; and if 
neither of x, x' extends the other, then the set in their common domain on which 
they agree is nonempty and definable. But if the last element of this set is not 
maxdom(x), we get a contradiction since the order is pseudofinite. 

Consider the subset of Xb given by: 

{a G Xb : there is x such that (p{x) and a G dom(x)} 

As this subset is nonempty and definable, by assumption it has a last element 
a* G Xb. Let X* G T be a function witnessing this, i.e. such that a* G dom(x*). 
Necessarily x* = maxX. 

There are three cases. 


Case 1. The desired case: range(x*) = W*. 

Case 2. Not case 1, but dom(x*) = Xb. Then 

^ “x* G 7b is an injection of Xb into Z” 
contradicting Definition |7.1| 
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Case 3. Not case 1 or 2, so doin(x*) C X\^ and range(ai*) C W. By Definition 


for successor, note that as the orders are pseudofinite, the function a:*''(S'(/(a*))) 
is well defined (meaning the function extending x* by the additional condition 
S'(a*) i-A 5'(/(a*)) is well defined). We may concatenate, so this new function 
belongs to T, contradicting the choice of a*. 

As Cases 2 and 3 are contradictory, we are necessarily in Case 1, which completes 
the proof. □ 


7.1 and the hypotheses of the Claim, “not case 2” implies lg(x*) < db- Writing S 


Conclusion 7.4. Suppose that s is a weak cofinality spectrum problem, and: 

(1) N C Mi s 'is definable and linearly ordered. 

(2) Arbitrarily large initial segments of N are orders for s, more precisely, there 
is tjj G A so that for any a G N there zs a G Or(s) with: 

{b £ N '■ \= b < a} C {b G Mi^s '0(^1 ®)} = C N and a < da- 

(3) Cardinality of initial segments of N grows internally, more precisely, letting 
9 = 9(w,y) define the tree associated to 'ip{xi,X 2 ,y), we have that Mi s H 
“(Vyo G N)(3yi G N){there does not exist z G 9(w,yi) such that z is a 
bijection from 'tp{x, x, yi) into ip{x, x, yo)) 

Let {W, <w) be a definable, pseudofinite linear order in the model. If there is an 
internal injection f of sets from W into some initial segment of N, then for some 
b G Or(s) with X^, C N there exists an internal order-isomorphism g from (W, <w) 
onto an initial segment of Yb • 


Proof. By the hypothesis, we can find bo such that Xb^ A f{W), and dbo > 
max(/(W)). Let tf:{z) be the formula in A defining the pseudofinite linear order 
corresponding to the initial segment below z, and let 6{z) define its associated tree. 
Then Mi s \= “(3z)(there does not exist x G 9{z) such that x is a bijection from 
fi{z) into Aibo)”. Let c be any such z. Again by hypothesis, there is b S Or(s) such 
that Ab A {x : X < c} and db > c. Now apply Claim 7.3 □ 


Claim 7.5. If s is a nontrivial weak c.s.p. and is hereditarily closed, then there 


exist nontrivial a, a' G Or(s) which together satisfy (**) o/1.5 


Proof. Let b (so also 7b) be nontrivial. In section 5 of [8], we showed that for 
any b G Or(s), it is possible to define addition, multiplication, and exponenti¬ 
ation on any element of Or(s), (that is, to define relations on Ab which have 
all the same properties as the graphs of these functions, except that they are 
possibly not total). This does not require any assumptions on pairing. This is 
done in the proof of [8] Lemma 5.3, essentially as follows. Addition is given by: 
(p+{x, y, z) = (377 G Th){lg{v) = 2 / A 77 ( 0 ) = x A 77 ( 7 / - 1) = z A (Vz)(7 < lg(77) 
ri{S(i)) = S{r]{i))). [We omit the parameter Cb for readability.] To obtain multi¬ 
plication, (px{x,y, z), substitute “(i < lg(77) r]{S{i)) = r]{i) + x)” as neces¬ 

sary, and define exponentation (pexp{x, y, z) by substituting in the appropriate place 
“{i < lg{r]) r]{S(i)) = rj{i) x x),” i.e. requiring that the sequence increment 

by a factor of x. These are graphs of partial functions, which need not be total. 
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We can therefore define “x is a prime.” Let ip 4 {x,y) assert that x is the yth prime 
by saying: y > 0A{3r] e 7^,)(lg(??) = yAv{0) = 2A'n{y-l) = xA{'ii){i < Igir]) => 
“r]{S{i)) is the <b-least prime number strictly greater than r]{i)”)). Let (f 5 {x,n,m) 
assert that x is divisible by the nth prime precisely m times, by asserting the ex¬ 
istence of ry S 7b of length m whose hrst element is x, whose subsequent elements 
decrease by a factor of the nth prime and whose last element has no more such 
factors. Let the formula ipQ{x,ri) assert that x G X^, is a Godel code for 77 by 
stating: “ij 7 ^ 0, 77 G 7b, x > 2 and for all i < lg{ri), writing m = 77 ( 7 ), we have 
that X is divisible by the fth prime precisely ?n. -I- 1 times”. Let 0{x) assert that 
(Vy < x){3z)ip+{x, y, z) A (Vt/ < x){3z)ip^ (x, y, z) A {Vy < x){3z)(pexpix, y, z). Let 
■ 0 ( 7 /) be the formula: 

(Vx < y)9{x) A (V ?7 G %) ((lg(??) < y A (Vf < lg(?7))(??(7) < y)) {3x){(fe{x, 77 ))) 

which asserts that Godel codes exist for all functions from X\^ \y to itself. 

For our present case, apply this as follows. Recall that Tfb is pseudofinite. 

First step: Find nonstandard n* < db so that the definable set Z of codes 
for pairs of elements of [0,n.t]b is contained in Fb- Second step: Find n*» G Tfb, 
n** < n* still nonstandard, so that Tfb contains all codes for functions from [ 0 , n**]b 
to itself. Third step: Let 777 * be maximal <b ti** such that < ri**, 

so necessarily tti* is nonstandard too. Let ai be such that Xg,^ = [0,77**]b and 

dai = TO*. 

Now define a so that Xa = [0,77i*]b and da = to*. What about the desired tree 
T of functions from Xg, to Xa x Xgl Recalling that dai = this tree is naturally 
isomorphic to the definable sub-tree T C 7 ^^ whose elements are functions whose 
range consists only of codes for pairs of elements each of which are < tti*. By 
construction, the codes for elements of and therefore for elements of T form a 
definable subset of Xb. Finally, let a' = b. 

This completes the proof. □ 


Discussion 7.6. By a similar argument, in any weak CSP which is hereditarily 
closed, for some nontrivial a G Or(s) we have available nontrivial elements of 
Or(s) which can be thought of as canonically representing any given one of the 
finite Cartesian powers a x • • • x a with the desired ordering, e.g. one derived 
from repeated applications of the Godel pairing function. However, as noted in 
Discussion 1.5. we don’t a priori have Cartesian products of distinct a,b G Or(s). 
This prevents us from obtaining the uniformity of functions such as Icf across all 
Xg^ which was necessary for the main theorems of [5] to go through. 


Definition 7.7 (Strong CSPs). Call s a strong GSP, or lexicographic CSP if the 
demands on Cartesian products from [ 135 ) are replaced by^ 

(1) 7/a,b G Or(s) then internally either < |Yb| or iFbl < |Pa|. 

(2) if a G Or(s) and d <a da then there is h £ Or(s) such that: 

(a) Xii — Xg,, G^b—db — d 

(b) Th = Ta \ {v - (lga( 7 ) <d) A (yn < maxdom(? 7 ))( 77 ( 77 ) < d)} 


16 


'So here A is retained. 
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(3) if a, h G Or(s) and h is a definabl^^ isomorphism from (Ya) <a) onto 
(Yb;<b) then there is c = a x h such that X^. = Xa x X^,, <c is the 
lexicographic order, = (da, Ob), and Tc is naturally defined. 

Observation 7.8. Any strong CSP is a weak CSP, and the hereditary closure of 
a strong CSP is a strong CSP. 


Claim 7.9. If s is a strong CSP which is hereditarily closed, then: 


(a) s satisfies Property (**) of Discussion 1.5 


(b) Moreover, for any nontrivial a,b G Or(s), there is a nontrivial c G Or(s) 
with either Xc = X^ x lb or X^ = Xb x Xa- 

(c) Suppose that for every a € Or(s) there is a! G Or(s) such that Xa is 
internally isomorphic to a subset of X^j and da' = max(Xa'). Then s is 
closed under Cartesian products. 


Proof. (1) By Claim 7.5 and Observation 7.8 


(2) Fix nontrivial a, b S Or(s). By condition |7.7[ 1), without loss of generality, 

|h^| < |hb| witnessed by an internal partial isomorphism h. Since Condition |7.7[ 3) 
requires h to be surjective, let d = /i(da) € Xb. Since s is hereditarily closed 
and d < db, apply Observation 1.12 to find b" G Or(s) such that Xb" = Xb and 
db" = d. Now h : ^ Xb" is onto, so by condition [L^ c) there is c = a x b" with 

Xc = Xa X Xb" = Xa X Xb and dc is nonstandard, thus c is nontrivial. 

(3) As da' = max(Xa'), db' = max(Xb'), we have that Xa' = Xa', Xb' = Xb', 

and the previous condition (2) shows that their Cartesian product exists. The 
hypothesis of (3) allows us to find Cartesian products for any two elements of Or(s) 
by first isomorphically embedding them in suitable larger elements a',b', finding 
c' = a' X b' and then applying hereditary closure. □ 


8. Towards a structure theory for NSOP 2 

In Section]^ we gave the first real evidence that the strong tree property SOP 2 
is a dividing line. Motivated by this result, we now look for the beginnings of a 
structure theory for NSOP 2 . The key objects are so-called higher formulas, defined 
using ultrafilters. The main results are first, Theorem |8.21[ which characterizes 
NSOP 2 in terms of few higher formulas; second, the Symmetry Lemma |8.15[ which 
characterizes NSOP 3 in terms of symmetric inconsistency for higher formulas; and 


third. Theorem 8.30 which proves that SOP 2 is sufhcient for a certain kind of exact 
saturation to fail. 


Convention 8.1. Throughout this section, T is a complete first order theory and 
£ = is a monster model for T. 


SOP 2 was defined in 6.1 above. SOP 3 was first defined in Shelah [13 as a 


weakening of the strict order property; note that in Definition |8.2[ the case where 
^ = -!(/? is the strict order property. 


^^Not necessarily via A. 
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Definition 8.2 ( [18] 2.20, [24] 1.3). T has SOP 3 if there is an indiscernible 
sequence {di : i < lu) and formulas ip(x,y), such that: 

( 1 ) {tp{fE,y),'tp{x^yy\ is contradictory. 

( 2 ) for each k < to, the following is a consistent partial type: 

{•ifix.dj) : j < fc} U {y>{x,di) : i > k} 

(3) for j < i, the set {tp{x,di),'ip{x,dj)} is contradictory. 

It is known that SOP 3 implies SOP 2 but it is open whether, on the level of 
theories, the converse is true; so it is possible that the Symmetry Lemma below 
will also characterize SOP 2 . (Still, for pairs {T,A) the converse fails since SOP 2 , 
SOP 3 are known to be distinct at the level of formulas.) 

We first look for a useful way to capture the asymmetry of SOP 3 . This approach 
relates to the idea of “semi-definability” from [TB] VII.4. 

Definition 8.3. If T) is an ultrafilter on A C (T™, then for any set B C we 
define: 

Ay{V,B) = {%f{x-,b) :b £ B,fj G [£], {a £ A ■.\= 'ip{d,b)} £ T)} 
so this is an element ofS"^(B). 

Definition 8.4. Let T> be an ultrafilter on "^A. (We sometimes write m = ni(I?) 
for this arity.) 

(1) We say that the infinite indiscernible sequence b = (bs : s £ I) is based on 
V when 

tp(&s,A-|-b>s) = Av(i:), A-I-b>s)) 
where b>s = lj{6t : t £ I, s <i t}. 

(2) For each V, let ob(T>) = oh('D^A) be the set of such b, i.e. the set of all 
infinite indiscernible sequences based on P (assuming the monster model £ 
is well defined). 

In Definition |8.4[ the elements approach A; of course we could have inverted the 
order. Given such an ultrahlter V and an inhnte indiscernible sequence built from 
it, we may naturally ask when a given formula instantiated along this sequence is 
consistent. 

Definition 8.5. Let A C C and = (p(x,y) = (p(x,y,c) fore € £. 

(1) Let Viiip(A) he the set of ultrafilters P on Wv)^ such that 
if h = (bg : s £ I) £ oh(P), then 

{(p(x,bs,c) : s £ 1 } 

is a consistent partial type. 


^®Usually, c is empty, and in any case, we can just incorporate it into the parameters y. 
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(2) For each k < uj, let be the set of ultrafilters T> on such that 

ifh = (bs ■. s G I) £ ob(I?) and Sq <j • • ■ <i Sk-i, then 

{(p{x,bst,c) :£ <k} 

is a consistent partial type. So when k = oo, we may omit it. 

We arrive at a key definition of the section: higher formulas {(p,A,T>), triples 
such that (fi is indeed consistent when instantiated along any b G oh(V,A). Two 
subsequent theorems of the section will characterize SOP 2 and SOP 3 in terms of 
the interaction of these higher formulas. 

Definition 8.6 (Higher formulas). Let rh = (mg, mi). Writing m instead of rh 
means mg = 1 and m = mi, or that mg is clear from the context. Let HF™ be the 
set of triples p = {(p,A,'D) where ip = (p(x,y) with £{x) = mg, £{y) = mi, and no 
more parameters, P is an ultrafilter on and 

V G uf^_fc(H). 

Definition 8.7. In the context o/ |8.6[ 

(1) LefHF’^=HF™ =nfcHFf. 

(2) We may wish to consider higher formulas over a fixed set A, or a using a 
fixed formula ip, in which case our notation will be: 

(a) Given A, we may write HF™(H), or “{p,P) G HF™(yl)”. 

(b) Let HF’^(H) = HF^(H) = H, HFf (H). 

(c) Given p = p{x,y), with £{x) = mg and £{y) = mi, we may write 
HF^=HF™,HF™fe(H), etc, where the subscript p means we restrict 
to triples whose first element is p with the given partition of variables. 

(d) Gall the elements o/HF^(H) “higher p-formulas over A.” 

Convention 8.8. In Defintion^S^l) , we may say “V is an ultrafilter over A” 
without mentioning mi when it is clear from context. 


We would like to study pairwise consistency or inconsistency of higher formulas as 
follows. Suppose we are given {pg,Ag,'Dg), {pi, Ai,'Di), (feg.s ■ s G Ig) G oh{Ag,Vg) 
and (&o,t ■ t G Ii) G oh{Ai,Vi). If we choose s G Ig and t G Ii, will pg{x,bg^s) and 
Pi{x, &i,t) be consistent? What if we choose finitely many instances from each list? 
The specter of SOP3 suggests that we should first fix an interpolation of Ig and Ii 
into a single linear order I and pay attention to the relative position of the indices 
s and t. The notation we now introduce in 8.9|8.10 is one way to handle this (most 
of the time we use cr = 2). 


Definition 8.9. (Partitions of linear orders, [Sh:950] Definition 1.39 ) 
Let Kp^a- be the class of triples 

(J,<z,(P/),<.) 

where I is linearly ordered by <j and (P/ : i < a) is a partition of I. 
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Definition 8.10. Fix a and suppose {{(pi, Ai, Di) : i < a) is a sequence of higher 
formulas. Let A = {Ai : i < a) and let D = {Di : i < a). Define 

oh{D) = oh{D, .4) 


to be the set of h = {bg : s G I) such that: 

(1) I G Xp,, 

( 2 ) if s G Pf then: 

• (-gijfs) = m(A)_ 

• tp{bs, U Aj U b>s) C Av(A) := Ay{Di, €r). 

j<a 

We may write A instead of A when all the A^ are the same. We may write i = 
i(s) = i(s,/) and we may write /g = J[b] for I. 


Note that in Definition 8.10 we do not require that b be indiscernible; in fact, 
it may consist of sequences of differing lengths, if the differ. 


Definition 8.11 (n-inconsistent higher formulas). Assume that for £ = 0,1, 

p, = {pe,Ai,Di)GllFf;. 

(1) We say {ipo, Aq, Dq) is n-contradictory to (ipi, Ai,Di) when: 

for every b G ob((ilo, Di), (Aq, Ai)) and every sq < ... < S 2 n-i with 
SI G Po'[b] for £ < n and si G f’/ib] for I G [n, 2n), we have that 

{(po(x,bsf.) : £ <n}U {(pi{x,bsi) : £ G [n, 2n)} 
is contradictory. 

(2) In “n-contradictory,” if n = 1 we may omit it and writing n = oo means 
“for some n”. Of course, “n-consistent” is the negation. 

(3) We say that [tpQ, A^f, Dq) and {ipi, Ai,Di) are mutually n-contradictory 
when Ippi, Ai, Dt) is n-contradictory to {pi-i, Ai-i, Di-i) for £ = 0,1. On 
the symmetry of this notion, see Lemma \8.1t^ below. 

(4-) “The set of {pi = {pi, Ai, Di) : i G S} are pairwise n-contradictory” will 
mean that each pair is mutually n-contradictory. 


Discussion 8.12. 

( 1 ) In^ 31 ) we could have allowed the choice of elements from the two par¬ 
titions to alternate. However, we will see this is immaterial for NSOP 3 , 
and moreover is a little less natural when replacing n-contradictory higher 
formulas by 1 -contradictory derived formulas arising as n-fold conjunctions. 

(2) This definition enforces an order between the elements Si in different par¬ 

titions; one could give a different definition requiring only that sq < ■ ■ ■ < 
^n—l and Sji P ‘ ‘ ‘ S2n—1- 


Definition 8.13. Say that T has symmetric inconsistency if, fixing m = £(x), for 
an-^mi,m 2 < uj, pi = pffx^m\,y[ 7 nt]) and {pt,Ai,'Di) G HF™'^ for £ = 1,2, 
we have that {pi, Ai,'Di) is 00 -contradictory to {p 2 , A 2 ,D 2 ) iff {p 2 , A 2 ,D 2 ) is 00 - 
contradictory to {pi, Ai,'Di). 


^®The notation 1 3 /[mi]) means that = m and t{y) = m^. 
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As desired, this definition picks up on the asymmetry of SOP 3 : 


Claim 8.14. If T has SOP 3 , then 1-inconsistency is not symmetric, i.e. T has 
symmetric inconsistency in the sense o/|8.13[ 


Proof. Let the sequence (a„ 
Let A = {cLn 


8.2 


\ n < uj) and the formulas (p{x,y), ip(x,y) witness 
n < w}. Let V be an ultrafilter on *s(y)^ such that 


SOP 3 , see 

{(in : n > k} GV ioi every k < oj. Let pi = ((^, A, V), p2 = ('0, A, T>). To see that 
P 2 is 1-consistent with pi but pi is not 1-consistent with p 2 , let I be the linear order 
a; + w*. Let (Pg, Pi) be any partition of I into two infinite sets, and let (bg : s G I) 
be as in|8.10|for {{'D,'D),(A, A)). □ 


Lemma 8.15 (Symmetry lemma). For T complete the following are equivalent. 

( 1 ) T is SOP 3 . 

(2) T has symmetric inconsistency. 


Proof. The direction (1) implies (2) is given by Claim 8.14 


For the other direction, we will show how an instance of symmetric inconsistency 
gives rise to SOP 3 . For notational simplicity, we use m = £{x) = 1, since for SOP 3 
the arity does not matter. Suppose we are given m 3 ,mi < oj and [ipi,Ai,'Di) G 
for ^ = 0,1. 

Let A = AqGI Ai, m = m 3 + mi and 


D = D3XD1 = {X C-^A : {do G ’"Mo : (di G ’"’(Ai) : do ''di G X} G Di} G D3}. 
By construction, D is an ultrafilter on ”^A. Suppose I is a linear order and 

a = (ds = do,s''dps : s G I) 

is an indiscernible sequence based on D, with £{at,^s) = mi, thus {ai^s : s G /) is 
also an indiscernible sequence based on Di for £ = 0 , 1 . For any h : I —t' {0,1}, we 
may consider the partition given by 

4 = {I, </, {Pi)i< 2 ) where = (s : h{s) = i} 

Then 4 G Ap ^o,!} and a/, := {ah(s),s ■ s G I) is 4-indiscernible based on {D 3 ,Di). 


Figure 1. A sample partition of 1 . 7 indexes a sequence of mo-F mi-tuples 
which is indiscernible based on D. Thus, restricting to the first mo elements of 
tuples with indices in the black regions gives an indiscernible sequence based 
on Do, whereas restricting to the last mi elements of tuples with indices in 
the grey regions gives an indiscernible sequence based on Di. 

Moreover, if {sa : a < ui lu) is < 7 -increasing, then: 

(1)„ the following are equivalent: 

(a) {(po(ic, do,Sc) : a < n} U di_s,„+„) : a < n} is contradictory 

(b) {q:> 3 , A 3 , D 3 ) is n-contradictory to (ipi, Ai, Di) 

{ 2 )n the following are equivalent: 
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Figure 2. Let the image indicate that we instantiate </?o ^ times along the 
Do-indiscernible sequence indexed by the black region and ^p-\_ n times along 
the Di-indiscernible sequence indexed by the grey region. 


(d) ■ ct < n} U : ct < r} is contradictory 

(e) (c/9i, Ai, D)i) is n-contradictory to {(po^ Aq^ Dq) 


Figure 3. Let the image indicate that we instantiate pi n times along the 
Di-indiscernible sequence indexed by the grey region and po n times along the 
Do-indiscernible sequence indexed by the black region. Then for any given n, a 
disparity in consistency between Figures 2 and 3 leads, by taking conjunctions, 
to an instance of SOP^. 

Let y = y^yi, = ipQ[x,y) = {x,yo,yi) = (po{x,yo), and (p^ = ipt(x,y) = 
(Pi (x,yo,yi) = (pi{x,yi), i.e. these are the given formulas formally considered as 
having more variables. Then for each n, to (1)„ above, we may add the equivalent 
condition: 

(c)„ : a < n} U : a < n} is contradictory 

Likewise, for each n, to (2)„ above, we may add the equivalent condition: 

(f)„ {(ppx,ds^ ) : a < n} U : a < n} is contradictory 

Now if it is not the case that for all n (c)„ iff for all n (f)„, we have a witness to 
SOP 3 for T (given by the conjunctions of n copies of (p^ and of i^i, respectively). 
This completes the proof. □ 

As a corollary of the proof of Lemma [8.15[ we have: 

Corollary 8.16. Assume T is NSOP 3 . If pe = {pe, Ai, Vi) for £ = 0,1 and po is 
n-consistent with pi for every n {i.e., not 00 - contradictory), then if I G a = 2 
and we have {bs : s G I) as usual, then {‘pt{x,hs) : s G P^ ,i < 2} is consistent. 

We now work towards Theorem |8.21[ using higher formulas to characterize 
NSOP 2 . First, we show that having SOP 2 means many pairwise 1-contradictory 
higher formulas. Recall that: 

Definition 8.17. Ded~'’(A) = sup{| lim(T)|“'' : T C ''‘>2 is nonempty, closed under 
initial segments and has no <i-maximal members and has cardinality < A}. 

Claim 8.18. Assume ip{x,y) has SOP 2 in T and X < p, < Ded(A). Then there is 
A C of cardinality A and Da G uf,^(A) for a < p such that {{p,Da) : a < p) 
are pairwise 1 -contradictory. 

Proof. Let the tree T witness that p < Ded(A) and let Va G lim(T) (i.e. the 
“leaves”) for a < p be pairwise distinct. Let (a^ : 77 S T) be such that: 
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(а) {ipix, Qri), ^{x, a^) are contradictory when 77 _L u are from T 

( б ) {^p{x, : a < £g(y)} is a consistent partial type for ij G T- 

Let A = Uja,, : 77 G T} and for a < /r let Da be an ultrafilter on 
concentrating on the branch Pq,, i.e. such that: 

if /? < £g{i'a), a < fi then {op : Va \ /3 ^ p< G Da 

Clearly these ultrafilters are as desired. □ 

We will need notation for finitary approximations to SOP2-tTees. 

Definition 8.19. We say that {T,(p) has NSOP 2 ,n when there are no brj G 
for 77 G "■>2 such that 

(1) 77 _L u => p(x, hri), 79(51, hif) are incompatible 

( 2 ) for ?7 G ” 2 , {p{x, ■. £ <n} is a type. 

Fact 8.20. {T,ip)^NSOP2 {T,ip) ^ NSOP2,n)- 

We now arrive at the second theorem of the section, which shows how from many 
pairwise contradictory higher formulas we may build an SOP2-tTee, complementing 
|8.18| Recall that by the Symmetry Lemma [8. 15| above, as NSOP 2 implies NSOP 3 , 
being contradictory is a symmetric notion. 


Theorem 8.21. For a theory T the following are equivalent: 

(1) For every infinite A and formula 79 , there are no more than |A| pairwise 
1-contradictory higher ip-formulas over A. 

( 2 ) T has NSOP 2 . 


Proof. In Claim 8.18 it was shown that SOP 2 implies many pairwise 1-contradictory 
higher formulas. So it remains to prove the other direction: many pairwise 1- 
contradictory higher formulas imply SOP 2 . 


Step 0: Setup. Let A = |A|+ and by Fact 8.20 let n be such that (T, 79 ) has 

NSOP2,n- 

Assume for a contradiction that: 


(1) {if, Da) G HF™(A) for a < A are pairwise 1-contradictory and 

(2) fixing some infinite linear order I, let Sq, = {ba,s '■ s G I) G oh{Da) for 
a < A. 


(Recall that the definition of 1-contradictory is for any such b.) We will use just 
that A = cf(A) > |A| > Hg. 


Step 1: Approximations. We define the set AP of approximations (to a full SOP 2 ,n- 
tree) to be the set of x consisting of: 

(1.1) A C ">2, a where: 

^Opere HF™„(A) suffices. 

^^Alternately, we could consider: in Aa;,frt{x) is a set of pairwise incomparable elements, e.g. 
the <]-maximal 77 E A of length < n — 1 . This is simpler here, but then the induction step would 
require two steps: add 77'^ (0) or 77"^ (1) for some 77 E frt(x). 
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(a) 

(b) 

(c) 

(d) 

(e) 

( 1 . 2 ) U = 
(a) 


(b) 

(c) 

(d) 


(e) 


A is non-empty downward closed 
d = {djf : r] G A) with each 

ii r] A v are from A then ip{x, drj), ^p{x, d,y) are incompatible 
if ?7 € A then {^{x, dj^n) : i < £g{r])} is a consistent partial type 
if G A then G A. 

(JJn '■ V € frt(A)), where: 

frt(A) := {rj G A : £g{r]) < n — 1 and rj'' (0) ^ A or r/' (1) ^ A} 

{the “frontier” for our inductive construction of a tree, i.e., the nodes 
without two immediate successors) 
each C X has cardinality A 

(the intention is a set of indices for the ha from Step 0) 

Ur^ CMAu = % ior rj V 

\i T] < V are from frt(A), k < to, sq, ■■■, Sfe-i G I, k + £g{'q) < n and 
a GUv then 

{‘p{x,dr^\t) : I < lg{vi)) U {(p{x,ba,se) :£ <k} 

is a consistent partial type. 

if ?7 e frt(x), s G I,a GU^ and v G A, ^{v < rf), 

then (p{x,ba^s),vix,cii^) are incompatible. 


Note the role of the two kinds of parameters: the ba,s from Step 0, and the pa¬ 
rameters dri for the tree. Informally, the Urj tell us in which sequences we can expect 
to continue our consistent partial type while maintaining inconsistency elsewhere. 

We dehne a two-place relation <ap on AP in the natural way: x <ap y iff 

(а) x,y G AP 

(б) A, C Ay 

(c) dx,,, = dy^jj for ry G Ax 

(d) if ry G frt(Ax) n frt(Ay) then Uy^ri A 

(e) if ry G frt(Ax), v G frt(Ay) and but w \ {£g{r]) + 1) ^ Ax, 
then Uy^i, C 


Step 2: Strategy. Clearly <ap is a partial order on AP. By choice of n in Step 0, 
if X G AP then A C ">2. Thus, to obtain a contradiction (and complete the proof) 
it will suffice to show that: 

(2.1) there is z G AP with A^ = {<>}, i.e. AP ^ 0 . 

(2.2) if X G AP then there is y G AP such that |Ax| < |Ay|, in fact, x <ap y. 

Step 3: Verifying Condition (2.1). Let Sq <i ... </ s„. For each a < A clearly 
£ 1= (dx) /\ ip{x,ba,st)- So by (1) and (2) of Step 0, 

£<n 

n 

Xa = {dG ^s(y)A : £ (= {3x)[ip{x,d) A f\ ip{x,ba,si)]} ^ Da- 

i=i 
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For each a < A, choose ba G Xa- [So ba is “canonically consistent” with the partial 
(fi-type given along the sequence Sq, by any n members.] As |A| < A, the set 
has cardinality < A = cf(A) so for some b the set 

U = {a < X : ba = b} 


has cardinality A. 

Now define z by: 

• = {<>} 

• a<> = b 

• = U. 

and z is as required. 

Step 4- Proving Condition (2.2). Let A = Ax. 

The situation at the inductive step is essentially as follows. We would like the 
tree to become full, so we choose g which is minimal for the property of not having 
two successors; say, q^\ is missing (there are minor adjustments at the end of 
this step depending on whether it has a successor at 0 or 1). We try to find a 
corresponding for the missing successor of this node, and its set of compatible 
indices subject to the following constraints: 

(i) consistency of Og-i with comparable nodes, (l.l)(d) 

(ii) inconsistency of Og^; with incomparable nodes, (l.l)(c) 

(hi) consistency of Og-i with large subsets of for compatible v for (1.2)(d) 

(iv) inconsistency of Og-; with for incompatible rj, for (1.2)(e) 

(v) disjointness oiUg^i from large subsets oiUv, for incompatible u, for (1.2)(c) 

In this informal explanation, “large” stands in for the fact that we will also have 
to refine the other lAr^ to get actual inconsistency or an actual empty intersection. 
This completes the description of intent. 

Now to begin, choose g G frt(A) be of minimal length, hence necessarily ^g{g) < 
n — 1 and we can choose l <2 such that g~ {l) ^ A. Let k = n — Ig(^i). 

Fix for a while a choice of a distinguished element of for each ly G frt(A), that 
is, a = {a^j : rj G frt(A)) where and let Sq </ ... </ Sfe_i. 

By our choice of g and (1.2)(c), for everjj^iy € frt(Ax)\{6i} we have that ^ ttg, 
hence the following set belongs to Da^ : 

Xa,^ =A’i,^ U where 

S : ip{x,b),ip{x,dy) are incompatible, where u G A A ^(u < p)} 

={b € : ^{x,b),p{x,ba^^so) are incompatible} 

since the {ip,'Da) are pairwise 1-contradictory and as {ai : I G frt(x)) is without 
repetitions by the assumption (1.2)(c) for X?^^ and (1.2)(e) for X^^^. 


p has precisely one successor in the tree, this successor may be from frt(Ax). 
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Furthermore, as (1.2)(d) holds for x, the following set belongs to Da^- 

Za,B ■■= {b G :{(p{x,a^^e) : £ < £g{g)} 

U{(p{x,b)} 

U {ipix, ba^^st) ■■ £ <n- £g{g) - 1} is a type} 

Let Xa = £^{Xa,ri '■ V G frt(A)\{g} and not comparable to p } n Za,g. Since A is 
finite and Da^ is a filter, X^ G Da^. 

By the choice of our sequence of ultrafilters in Step 0, for every /? G 
we know that {(p,Da^), (ip^Dp) are 1-contradictory. So 

y &,0 = {& G ^s{y)A : ip{x, h), if{x, 6 / 3 .S 0 ) are incompatible} 

belongs to Da^. So we may choose ba ,0 G which belongs to X^ H 3 ^ 3 ,/ 3 - As 

l^x.gl = A = cf(A) > |A|, there is 6 a G ’^s(y)j[ sucii that 

Wa = {/? G ££-x.,q • ba^fH — 6 a} 

has cardinality A. 

Recall that all of this is for a fixed a, {sq, ..., Sfc_i). 

Now continue to fix sq </ • • • </ Sk-i- For every 7 < A we let = {a^^n '■ V G 
frt(A)) be defined by 

= min(6/x,r,\7) 

which is well defined as 6 /x,j) is an unbounded subset of A. So for every 7 < A, we 
have that a^,ba^,Wa^ are well defined. So for some 6 * we have 

= {7 < A : 6 a^ = 6 *} 

is an unbounded subset of A. 

We can now define the necessary objects, in two cases. For Case 1 below, the final 
definitions depend on whether the node we are dealing with has a sibling or not. 
Case 1 : 1 = |Ax C {p'(0), gi'(l)}| 

Let L be such that g'(t) ^ Ax. We define y as follows: 

0 (a) Ay = Ax U {^"(i)}, hence frt(Ay) = frt(A) U {£i'(i)}\{£»} 

( 6 ) by ^j is b^ Yj if ^ G Ax 

(c) 6 y_^ is 6 * if ?7 G g' {l) 

(d) if ?7 G frt(A)\{p} then Uy^rj is {a G for some 7 < X,ba^ = 

6 * and a = a^^n} 

(e) if r/ = g"{ l) then Uy^^i = {a G Uy^ g\ for some 7 < A, 6 ^^ = 6 * 

and a = 0 : 7 , 5 }. 

For clause (e) recall 6 * G Xa,g C Za^,g- 
As G frt(x), we are left with Case 2: 

Case 2 : 0 = |Ax C {p"(0), ^)'(1)}| and let t = 0. The only difference is that 
• in clause (a), frt(Ay) = AU {e'(t)} 
so we have to add 

(/) if ry = p then 6 /y,^ = for some 7 < A such that ba^ = 6 *. 
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Step 5: Finish. Recalling Step 2, we have shown that the assumption of |4l|+- 
pairwise 1-contradictory higher formulas contradicts NSOP 2 . This completes the 
proof. □ 

In this theorem, replacing 1-contradictory by n-contradictory would be straight¬ 
forward as we can replace tp by a conjunction, defined as follows. 

Definition 8.22. Given ip and n, let 

F[n\ —y[n]) 

=F[n\{x, {yi-.i< eg{y) ■ n)) 

= A • j < ^9{y)))- 

£<n 

We say ip = p{x,y) has NSOP 2 robustly when no </?[„] has SOP 2 . 

Observation 8.23. If T is NSOP 2 then every p{x,y) G C{tt) has NSOP 2 ro¬ 
bustly in T. 


In the last main result of this section, we apply Theorem |6.14| characterizing the 
maximal class in <* to prove another property of SOP 2 , related to so-called exact 
saturation (meaning for which singular k a given theory T has a model which is 
K-saturated but not K^-saturated). Exact saturation was studied in Shelah [22] §2 
(pps. 31-37) and in a manuscript of Kaplan and Shelah |7] in preparation, which 
deal with elementary classes and (D, /t)-sequence homogeneity. 

Definition 8.24 ( see Ea, m )• For any theory T, define 
spec(T) ={k: k > |r|, k singular 

and there exists a n-saturated not k'^- saturated model ofT}. 

The papers |52| and [7| find sufficient conditions but not necessary and sufficient 
conditions for exact saturation. In the present paper, we define a pseudo-elementary 
versiorp^ of this spectrum, which we will connect to SOP 2 via <*. 

Definition 8.25. The exact saturation spectrum for T is defined to be the set: 

ESS(T) ={(k, /i): K > p > \T\, K singular and for any Ti D T, |Ti| < p, 
there is a K-saturated not -saturated member of PC{Ti,T)}. 

In future work, we hope to be able to get necessary and sufficient conditions for 
ESS(T) to be empty (at least restricting ourselves to k strong limit of large enough 
cofinality), and it seems plausible that this may be SOP 2 . Here, using the methods 
of Section we will prove one direction: if T has SOP 2 then ESS(T) = 0, and 
discuss several open questions. First we recall two known examples. 

^^Compare the results of m VI .5 connecting the minimum class in Keisler’s order to saturation 
properties of a PC-class. 
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Fact 8.26 ([22], |7|). Let T be the theory of dense linear order without endpoints. 
Then for any singular n > \T\, if M \= T is n saturated then it is k,'^- saturated. 
Thus spec(T) = 0. 

Proof. By quantifier elimination, it suffices to show that the cofinality and coini- 
tiality of M are at least k and for any regular ai, K 2 , every (ki, K 2 )-pre-cut is filled. 
Since cofinality and coinitiality of the model and of pre-cuts are necessarily regular 
cardinals, the result is immediate. □ 

Fact 8.27 ( [22] Example 2.23). There is a theory T with the independence property 
such that: if T has an exactly K-saturated model then k is regular. (In fact it is 
necessary and sufficient that k be regular.) Thus spec(T) = 0. 

Recall the order <* from Definition |6.7| above. In the following, countability is 
not essential. 

Observation 8.28. Suppose Tq, Ti are countable theories which are equivalent 
under the <* order. Then there exists a theory T* which interprets both Tq and 
Ti, say via ^ and Tpi respectively, such that: for any model M \= T*, and any 
uncountable k, 

is K-saturated if and only if is K-saturated. 

Proof. We may assume Tq and Ti have no finite models. Let p be such that we 
have Ta witnessing Tq <* Ti and Tf, witnessing Ti <* Tq, and we may assume 
\Ta\, \Tb\ < p. Let interpret in Ta for I = 0,1, and let interpret in 
for ^ = 0,1. Without loss of generality: 

• r(To) and r(ri) are disjoint. 

• says that for any model M \= Ta the universe of is for 

some unary predicate Pf, and Ta implies that Pf and Pf are disjoint; 

• similarly for T^. 

• Tpf is the identity, where this means: 

- r(r„)D (r(ro)Ur(ri)) 

- P e T{Ti) implies (pfp = P, and Ta b (Vx)(P(S) ^ ye<ig(x)Pi,aix)) 

- similarly for function symbols F G rlTg), adding that they are inter¬ 
preted as partial functions with domain the predicate (alternately, 
we could have assumed without loss of generality that r(P^) has only 
predicates). 

• each is likewise the identity. 

. T(T,)nT(rb) = (T(Po)UT(Ti)). 

What remains is to find models Ma \= Ta and Mb ^ Tb such that the interpre¬ 
tation of in Ma and Mb are isomorphic. Given such models, we may finish by 
adding additional symbols giving a bijection between the respective interpretations 
of To and Ti. 

One way to construct such models is to recall that ultrapowers commute with 
reducts, and that any two elementarily equivalent models have isomorphic ultra¬ 
powers. Begin with \= Ta and Mo,b |= Tb. Choose the ultrafilter Vq so that the 
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I?o-ultrapowers of and are isomorphic. Call these ultrapowers Mi^a 

and Mi,t, respectively. (As ultrapowers commute with reducts, we may consider 
Mi^a and as models of the full Ta and Ti, respectively.) Consider the model 
Me which is the disjoint union of Mi^a and Mi f, and expand by adding symbols 
giving the isomorphism between and Let have the obvious 

meaning of considered within this model M^. Next, choose the ultrafilter Vi 

so that and are isomorphic. Let M* be the -ultrapower of Me- In 

this model we may expand Tc so as to make the interpretations of Ti isomorphic. 
Let T* be the theory of this expanded model. This completes our construction. 

We had fixed an infinite fj, so that \Ta\ + \Tb\ < and [Tol -I- [Til = Hq by 
assumption. The construction gives that also |T*| < /r. □ 

Corollary 8.29. 

(1) Let To be any theory for which spec(To) = 0. Let Ti be any theory such 
that To and Ti are equivalent in the order <*. Then ESS(Ti) = 0. 

(2) Suppose Tq, Ti are <i*-equivalent, as witnessed byT^, with |T*| < p. Suppose 
K> p is singular and {k, p) ^ ESS(To). Then {k, p) ^ ESS(Ti). 

Proof. (1) Let T* be a theory witnessing their equivalence, such as that given by 
Observation |8.28[ Let Let and ^ witness the interpretations for Tq and of 
Ti, respectively, and let and denote the respective interpretations in 

a given model N \= T^. Now let k be a singular cardinal, k > |Ti| and suppose 
M G PC'(T*,Ti) is K-saturated. Let N |= T* with M = N f t(Ti) witness that 
M G TC'(T*,Ti). The fact that M is K-saturated says precisely that is k- 

saturated. By hypothesis of equivalence, is K-saturated as well. By choice 

of To, is ^'''-saturated. Applying the hypothesis of equivalence in the other 

direction, N^vo] jg K+-saturated. This completes the proof. 

(2) As (k, p) ^ ESS(To) there is a theory Too 2 To, |Too| < p, and a K-saturated 
not K^-saturated member of PC{Tqq,Tq). In order to make use of this, we would 
first modify the construction of the theory T* (by means of a better choice of Ta,Tb) 
so that for any M* \= T* we have that G TC'(Too,To). Since |Too| < p, we 

can do this while preserving |T|.| < p. Then the proof continues as in part (1). □ 

Theorem 8.30. If T has SOP 2 then ESS(T) = 0. That is, if T has SOP 2 then 
for some Ti A T of cardinality |T|, for every singular k > \T\, if M G PC{Ti,T) 
is K-saturated then it is -saturated. 


Proof. By Theorem 6.14 Fact 8.26 and Corollary 8.29| (1). 


□ 


Question 8.31. Does Theorem 8.30 hold for the theory T^g of the random graph? 


In the case of spec(Trg) rather than ESS(Trg), note that: 


Claim 8.32. If k > cf(K) -I- |T| then n G spec(Trg). 

Proof. Let M he & K^-saturated model of T^g. Let (a^ : a < k) be pairwise distinct 
members of M which form an empty graph, i.e. a < /3 < X ==> M |= ^R{aa, ap). 
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Consider the submodel N C M whose domain is 

{beM : {3<^a < k) ( R{b,aa) )}■ 

Then iV is a model of T^g which is as required: it is ^-saturated but {R{x, Oq,) : 
a < k} is omitted so it is not «:+-saturated. □ 

Before giving some further evidence, we record here that there are other natural 
directions these investigations could take. 

Discussion 8.33. Instead of asking whether k G ESS(T) for k > cf(K) + \T\, we 
may fix a specific way to construct a K-saturated model and ask if this implies that 
the constructed model is nf' -saturated. For example: 

(a) we may consider T dependent, \M\ = {oa '■ a < a*}, Ua G [a]'''*, tp(aQ,, {a^ : 
j3 < a}) does not split over {ap : P < ot\, and M is K-saturated; see [20]. 

(b) as in (a), but we may ask that T has Skolem functions. 

(c) as in (b), and also tp(aQ,{a^ : /3 < a}) is finitely satisfiable in Sk({a^ : 
j3 G Ua\), see [H], VII, section 4- 

(d) we may consider models built using V~ (n)-diagrams in some explicit way. 

Returning to ESS, on the positive side we can settle the case of stable T. 

Claim 8.34. Let T be a complete theory. If T is stable, k = > cf(K), and 

K > fJ, > T, then {K,fi) G ESS(T). 

Proof. Recall that under these cardinal hypotheses there is a model of T of car¬ 
dinality K which is K-saturated, see [TB] Chapter III Theorem 3.12. Clearly this 
model is not K“'"-saturated. Given any Ti D T, |Ti| < p., we may build a model 
of Ti of cardinality k in the same way whose restriction to T is K-saturated but 
evidently not K“'"-saturated. □ 

Question 8.35. What about simple theories? 

Problem 8.36. Determine whether the following is true: forT complete and count¬ 
able, 

ESS(T) = ib if and only ifT has SOP 2 . 


These investigations suggest some interesting parallel questions for ultrafilters. 
The reader may recall that if A is a singular cardinal and the ultrafilter is A-good 
then it is A^-good (since linear order is in the maximal Keisler class, [Tn].VI.2, a 
proof similar to that of Fact 8.26 goes through). 


Problem 8.37. Suppose A is singular. Does there exist a regular ultrafilter which 
X-saturates but does not X'^-saturate ultrapowers of the random graph? 


The property of an ultrafilter being “(A, Ho)-perfect” was defined in [TU] . 


Problem 8.38. Suppose X is singular. If D is a regular ultrafilter which is (k, Hq)- 
perfect for every k < X, is D also (A'*', Ho)-perfect? If not, must it at least produce 
X~^-saturated ultrapowers of the random graph? 
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